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The invention is 



described in the following statement:- 



-2- 

The present inventio,^ relate u, a paper based information interface, 
me invention, have been developed printarily for electronic commetce and will be 
described hereinafter with ..fer^ce to that application. However, it will be appreciated 
that .he inventions are no. limited ,o this particular fleld of use and a. also suitable for 
S non-business related infomtation tiansfers such as that used by libraries, govenunen. 
organisations or households. 

According to a fit^t aspec, of the invention there is p^vided a system for allowing 
a user to interact with one or more computers, the system including pages upon which 
are disposed tag elements, such a,at designation by the user of any one of Ute tag 
10 elements results in instntctions being apphed in relation to the computer. 

Preferably, some or all of the printed elements include identity data, the identity 
data for each tag element either: 

uniquely identifying particular ones of tire instructions generated to ..lation to a,e 

computer; 



umquely identifying a relative position of that tag element in relation to 



the page; 



or 



uniquely identifytog a relative position of ti,a. ti,g element to relation to U,e page 
and uniquely identifying U,e page upon which that tag element is disposed. 

Preferably, the identity dau is no, t«t or data ti., is oflterwis. semantically 

20 understandable to a user. 

Pref^ably. the user designates one of the tag elements by means of a tag element 

reader. 

Preferably the reader takes the physical form of a stylus. 
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tViP rnrre<?nondine tag elements of each page are 
Preferably the pages are paper and the corresponaing 

printed thereon. 

In a preferred form of the first aspect, there is provided a system in which paper 
pages containing printed elements can allowauser to interact withacomputer system 

5 without having to explicitly enter control information into the computer system. 

Preferably, the computer system is able to identify unique page elements, or 
unique page elements within unique pages, without explicit user knowledge. 
Preferably, the preferred interaction technique uses an intelligent pen. 
Preferably, the use of the term "paper" in these claims encompasses other media 

10 such as plastic. 

According to a .econd aspect of the invention there is provided a printer for 
printing pages, the pages being useable by a user ,0 interact with a computer. 

Preferably, the printer is configured to print one or more tag elements onto each of 
.he pages, each of the tag elements including identity data, the identity data for each tag 

15 element either: 

uniquely identifying instructions useable for controlling Ure computer; 
uniquely identifying a relative position of that tag element on its respective page; 



or 

uniquely identifying a reUtive position of tira. tag element on its respective page 
20 and uniquely identifying the page upon which that tag element is disposed 

Preferably, the printer is configured to print the tag elements using an ink that is 
invisible, or at least substantially not visible to tire human eye. Preferably also, tire 
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printer is configured to selectively print additional data onto the pages using one or more 
colours other than the invisible or substantially not visible ink. 

In a preferred form of the second embodiment, there is provided a printer that can 
print documents as sets of pages of interactive paper. 

According to a third aspect of the invention there is provided a printer configured 
to print a second document in response to selection of identity data disposed on a first 
document, wherein the identity data on the first document identifies the second 
document, thereby enabling retrieval of the second document from an electronic storage 
means for reproduction by the printer. 

Preferably, each document is defined by a set of one or more associated pages, the 
printer being configured such that printing of a document includes printing all of the 
pages of that document. 

Preferably, the identity data is read by a reader and transmitted to a receiver 
associated with the printer by a transmitter associated with the reader. 

In a preferred form of the third embodiment, there is prx>vided a printer that can 
print documents directly in response to requests initiated through interactive paper. 

Preferably, the printer is configured to print documents as sets of pages of 
interactive paper 

According to a fourth aspect of the invention there is provided a system for 

20 -"owingausertointeractwithoneormorecomputers,thesystemincludingpagesupon 
which are disposed one or more text-based tag elements, such that designation by the 
user of any one of the tag elements results in instructions associated with that tag 
element being applied in relation to the computer. 
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Preferably, the instructions associated with the tag element cause a printer 
operatively connected with the computer to print outapage associated with the tag 

element. 

Preferably, toe Ug element is linguistically or semantically m.der«andable by a, 
5 least some sub-group of users. 

Preferably, the tag element takes the form of a hyperlink. 

U a preferred embodiment of the fourth aspec, there is provided a system in which 
awordorphrase on interactive pap^ can cause, when selected byauser,aprin.er to 

print a document linked to that word or phrase. 

According to a fifth aspect of the mvcntion there is provided a system for aUowing 
a„scrtoi„teractwifl.oneormorecomputers.thesystemmcludingpagesuponwhich - 

are disposedone or more grapUcal tag elements, such thatdesignationbytiteus^of any 
one of the tag elements results in instructions associated with ma. tag element being.- 

appUed in relation to the computer. 
,5 Preferably, the instructions associated with the tag element cause a printer 

operatively com>ccted with the computer to print out a page associated with tire tag 

element. 

Preferably, the tag element is linguistically or semantically understandable by at 

least some sub-group of users. 
20 Preferably, the tag element takes the form of a hyperlink. 

to a preferred embodimem of the fifth asp^t, there is provided a system in which a 
graphic on inte«ctive paper can cause, when selected by a user, a computer sys^ to 
carry out an action linked to that graphic. 
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According to a sixth aspect of the invention there is provided a system of capturing 
stroke data in relation to one or more strokes generated by a user, the user applying the 
strokes by means of an active stylus to a page upon which is disposed a plurality of tag 
elements, each tag element including identity data defining a relative location of that tag 
5 in relation to the page, the active stylus being configured to periodically read tags as 
each stroke is being generated, wherein the stroke data includes a sequential plurality of 
the identity data of tags that have been read by the stylus. 

Preferably, the identity data is periodically read by the stylus and then transmitted 

to a memory module. 

Preferably, the stylus includes a pressure sensor for detecting a pressure applied 
between the stylus and the page by a user. In this embodiment, it is preferable that the 
stroke data include pressure data. Preferably also, the pressure data is inter.pei.ed with 
the identity data or trans. 

In other embodiments, at least a plurality of the identity data are timestamped. 
15 In a preferred form of the sixth embodiment, there is provided a system in which 

fi-eehand drawing by a user on interactive paper is c^tured by a computer system as 
"digital ink". 

According to a seventh aspect of the invention there is provided a system of 
converting stroke data generated in accordance with the sixth aspect of the invention into 
20 computer text data, the system including text recognition means for converting each 
stroke or combination of strokes into computer text data. 



In a preferred fonn of the seventh aspect, there is provided a system in which text 
hand-written by a user on interactive paper is automatically converted by a computer 

system to computer text. 

According to an eighth aspect of the invention there is provided a system of 
verifying a signature or other handwritten authentication symbol on the basis of stroke 
data generated according to the sixth aspect, the system including means for processing 
the sequential plurality of identity data to verify that the signature falls within a 
predetermined range of geometrical tolerances. 

Preferably, where the stylus includes a pressure sensor, verification of the 
signature includes assessing whether the pressure associated with each of the sequential 
plurality of identity data is within a predetermined acceptable range. 

Preferably, where the identity data is timestamped, verification of the signature 
includes assessing whether the total elapsed time impUed by the timestamps, or relative 
times calculated between predetermined identity data of the pluraUty of sequential 
15 identity, fall within a predetermined acceptable range. 

Preferably, the system includes token comparison means for confirming that a 
token provided or entered into the system by the user corresponds with the signature. 
Preferably, the token takes the form of identification data provided by the stylus along 
with the stroke data, the identification data of the stylus being associated with one or 
20 more potential signatures to be verified. 

In a preferred form of the eighth aspect, there is provided a system in which a 
signature hand-written by a user on interactive paper can be automatically verified by a 
computer system. 
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Preferably, the signature is verified against known characteristics of the user's 
signature. 

Preferably, the user's identity is provided expUcitly to the computer system 
immediately before, during or immediately after generation of the signature for 
5 verification via an identity token. Preferably, identity token is the user's intelligent pen. 
According to a ninth aspect of the invention there is provided a digital printer 
including: 

(a) a printing mechanism for printing onto individual sheets of paper; 

(b) paper output means for outputting the sheets of paper after printing; 
10 (c) a binding mechanism including: 

(i) glue application means for applying glue to a predetennined portion of selected 
ones of the sheets of paper; 

(ii) a collator for routing printed pages into contact with each other, such that those 
portions to which glue has been applied are in contact with appropriate portions on other . 

1 5 adjacent sheets of paper. 

Preferably, the printer fiuther includes pressure application means for squeezing 
the glued portions together with corresponding portions on the adjacent sheets of the 
paper. 

Preferably, glue is applied to a single edge of a plurality of sheets of paper in a 
20 bundle of sheets to be glued together. 

Preferably, the digital printer is configured such that a multiple page docmnent is 
recognised as such, and is glued together in a discrete bundle. 
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m a prefemd form of *e nin* aspec, *ere is provided a digital printer wUch 
automaticany bind, the pages of a document together using an internal binding 
mechanism, including one or more of a gluing mechanism, a stapling mechanism, or 
other chemical or mechanical binding means. 

According to a tenth aspect of the invention there is provided a c^dge for use 
with the digital printer of the ninth aspect, the cartridge including: 
a supply of one or more inks or colorants for the printer, and 
a supply of adhesive for supply to the binding mechanism. 
According to an eleventh aspect of the invention there is provided a method of 
, distributing content to a plurality of users via a netwot* document distribution system, 
the method including the steps of: 

defining one or more groups of users, each group having associated with it 
predetermined page layouts, content elements or content definitions; 

defining an individual profile for one or more of the users, each mdividual profile 
,5 including predetermined page layouts, content elements or content definitions; 

for each group, broadcasting content associated with that group to the individual 

users within that group; and 

for each individual, pointcasting content associated with the user's profile to the 



user. 

20 



Preferably, the method further includes the step, for each user, of compiling the 
broadcast and pointcast content into a single document. 

According to a twelfth aspect of the invention there is provided a network 
document distribution system in which unique page elements and/or layouts are 
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pointcast to individual receivers and shared page elements and/or layouts are multicast to 
groups of receivers. 

According to a thirteenth aspect of the invention there is provided a system in 
which the logical content of a printed page is persistently archived in such a way that any 
i user interaction with the printed page at a later time can be interpreted with respect to the 
logical content of the page. 

According to a fourteenth aspect of the invention there is provided a system in 
which a user can make an onhne payment exclusively by marking and/or signing paper 
pages which represent payment instructions. 

Preferably, payment card information is linked to the user's identity on the 
network. More preferably, the user's signature and the user's identity token (for 
example the user's intelligent pen) together allow the computer system to authenticate 
the payment. Payment forms can include statements deUvered regularly to a user's 
printer, as well as online order forms printed interactively. 

According to a fifteenth aspect of the invention there is provided a system in which 
a user can make an online purchase exclusively by marking paper pages printed on 
demand. 

According to a sixteenth aspect of the invention there is provided a system in 
which a user can make an online purchase exclusively by marking pre-printed paper 
pages. 

Preferably, the pre-printed pages include flyers, brochures and catalogues delivered 
by traditional means. 
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According to a seventeenth aspect of the invention there is provided a system in 
which a user can brov.se the World Wide Web exclusively by viewing and marking 

paper pages printed on demand. 

Preferably, hyperlinks embedded in Web pages remain active when printed on 
3 interactivepaper^andwhenselectedrequesttheprintertoprintthelinkedpages. More 

preferably, because of the greater resolution of the printed page, Web pages intended for 
screendisplayareprintedintwocolumnsandataboutsixtimesthedensityofscreen 

display. 

Accordmg to an eighteenth a^ect of the invention there is provided a system in 
,„ which advertising is automatically placed o„ the reverse side of an interactive paper 
sheet if the reverse side is otherwise empty. 

Preferably, the minimum unit of output ftom an interactive printer is a two-sided 
sheet of paper. In many interaction sequences the second side of the page will be empty, 
and thus provides space for advertising lie advertising is non-intrusive, and ald^ough it 
,5 may not be seen immediately, it persists on the page and may be seen later. 

According to a nineteenth aspect of the invention there is provided a system in 
which a user can browse a di^tory of information exclusively by viewing and marking 

paper pages printed on demand. 

Preferably, the directories, such as of people, places, services, and the like, are 
,„ ubiquitous. Assuming200entriesperprintedsheet,thestandardunitofinteraction.a 
global phone book for six billion people requires only five index levels, and a user can 
find a specific entry by printing only five sheets of interactive paper. 
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According to a twentieth aspect of the invention there is provided a system in 
which a user can obtain printed product infonnation on demand via a product's universal 
product code (UPC) bar code, via a bar code scanner communicating directly with a 
printer. 

i Preferably, product infonnation in the form of usage instructions, warranty 

information, promotions, and the like, are linked directly to any product which bears a 
universal product code bar code. More preferably, a user scans the product's bar code to 
request that the infonnation be printed on the user's printer. More preferably, if the 
product infonnation is printed as interactive paper pages, then the user can navigate a 
whole collection of product infonnation starting with just a single page. Even more 
preferably, the bar code scanner is ideally integrated into the user's intelligent pen. 

According to a twenty first aspect of the invention there is provided a system in 
which interactive content for both the World Wide Web and interactive paper can be . 
generated from a single content description. 

According to a twenty second aspect of the invention there is provided a 
application system which can present both a World Wide Web user interface and an 
interactive paper user interface. 

According to a twenty third aspect of the invention there is provided a system for 
providing printed infonnation to a user that is obtained from a remote source, the system 
including: 

a user printer module that is provided by a first party to the user for interfacing the 
user with the soun^e, the module being responsive to the user requesting first infonnation 
from the source for obtaining the first infonnation and generating a first printed media 
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displays .o *e user *e firs. MormaUon .ogefter .im second informaficn derived 

from a second party; 

identifier means for applying an identifier » *e firs. pri„«d media such *a. 
designation of ti>e identifier by .he user resulu in tt,e module generating a second prin.ed 
5 media tt.a. displays U>*e user third infonnation; and 

calculation means responsive to the module for the determining a financial debit 
that is applied by the first party against the second party. 

Preferably, tiie system includes a plurality of modules associated with 
correspondingusersandthedebitisapredeterminedfiu.ctionofmenumberofprin.ed 

,„ .edia generated ti.t display the second infom^tiou. In other embodiment, the debi. . 
a predcermined fimction of tire number of printed media generated that display the ^ 
information. In still fiuti.er embodiments tite debit is a predetermined fimction of bod. 
the number of printed media generated *a. display *e second information and the ; 
number of printed media generated *a. dispUy ttte tturd information. 

Preferably al«,. d-e second par.y is a supplier of goods and/or services and tire 
second information or tite titird information aUows tite user to purchase titose goods 
and/or services at a predetennined purchase price. Preferably also, tite debit is a 
predetermined fimction of tite purchase price. For example, in some embodiments the 
debit is a flat fee for each put^hase while in ofl>er embodiments tite debit is a fixed 
,„ proportionoftitepurchaseprice. m still fiuther embodiments. ti.e fixed proportion 

varies and is dependent upon tite particular goods and/or services purchased by ti>e user. 
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In a preferred fonn, there are a plurality of second parties and the quantum of the 
debit is contingent upon one or more of the following characteristics of the respective 
second party: 

• geographic location; 

5 . quantity ofpurchases completed in a given time period; and 

• relative geographic location with respect to the user. 

Preferably, the identifier is a tag. More preferably, the identifier is a plurality of 
tags spaced apart on the respective printed media. 

In some embodiments the identifier is a character string that the user provides to 

0 *--oduletoobtainthethirdinforrnation.Forexample,thestringmayinclude^ 
sequence of numbers that are manually keyed into the module. More preferably, 
however, the string is manually scanned by the user. 

According to a twenty fourth aspect of the invention there is provided a method for 
providing printed infomration to a user that is obtained from a remote source, the method 
including the steps of: 

having a fte party provide ,„ a ^er a u,ar printer module for interftcing a,e user 
wia, .he .ou.^, fl,e module being responsive U> the user requesting firs, information 
from the source for obWning u,e first infbnnation and genen,Hng a firs, printed media 
.ha, displays .o dre user the firs. infon„a.ion .ogether wiflr second information derived 

from a second party; 

applying an identifier to the fir.t printed media such that designation of the 

identifier by the user results in the module generatingasecond printed media that 
displays to the user third infonnation; and 
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determining, in re^nse ,0 fte module, a financial debit .ha. is applied by *c fira. 

party against the second party. 

Aecording to a twenty fifth aspect of the invention there is provided a system for 
providing primed information to a user that is obtained from a remote source. *e system 

5 including: 

processor means for providing firs, infomration derived ftom a first party; 
a user printer module that is provided by a second party .0 the user for interfacing 
,heuserv.iththesour^.themodulebei„gresponsive«.theuserre,uestinBseeond 

infomtation tern the source for obtaining the second infomation and generating a firs. 
,„ printed media that displays to tire user the second information together with U.e first 

information; 

identifier means for applying an identifier to the first printed media such flra. 
designation of tire identifier by the user results in tire module generating a second printed 
media that displays to the user ttlird information; and 

payment means for receiving a predetemuned payment fl.,m the first party .o *e 
second party and for generating a disable signal if that payment is not made wherein tire 
generation of tire disable signal prevents the module obtaining tire second information. 

According to a twenty sixth aspect of the invention ttiere is provided a method for 
providing printed information to a user that is obtained ftom a remote source, the method 

20 including the steps of: 

providing first information derived from a first party; 

interfacing the user with the source with a user printer module that is provided by a 
second party, the module being responsive to the user requesting second information 
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from the source for obtaining the second information and generating a first printed media 
that displays to the user the second information together with the first information; 

applying an identifier to the first printed media such that designation of the 
identifier by the user results in the module generating a second printed media that 
5 displays to the user third information; and 

receiving a predetermined payment from the first party to the second party and for 
generating a disable signal if that payment is not made wherein the generation of the 
disable signal prevents the module obtaining the second information. 

According to a twenty seventh aspect of the invention there is provided a system 
10 for providing to a user printed first information about a first party that is obtained from a 
remote source, the system including: 

ihemory means at the remote source for storing the first infonnation; 
a user printer module that is provided by a second party to the user for interfacing 
the user with the source, the module being responsive to the user requesting the first 
15 information for obtaining the first information from the memory means and generating a 
first printed media that displays to the user the first infonnation; 

identifier means for applying an identifier to the first printed media such that 
designation of the identifier by the user results in the module generating a second printed 
media that displays to the user second information; and 
20 calculation means responsive to the module for determining a financial debit that is 

applied by the second party against the first party. 
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According to a «venW eigh* aspect otte invention .here is provided a method for 
providing to a user printed first information about a first party ^ is obtained fiom a 
remote source, the method including the steps of; 

storing the first infomration in memory means at the remote source; 
interfacing the us« with the sour^ with a user printer module tha is provided by a 
^„d party to the user, the module being responsive to the user requesting the first 
informafion for obtaining the first information ixom me memory means and generafing a 
first printed media that disphiys to the user the fttst information; 

applying an identifier to the first printed media such that designation of the 
,0 identifier by the user results in the module generating a second printed media that 
displays to the user second information; and 

being responsive to the module for determining a financial debit that is appUed by 

the second party against the first party. 

According to a twenty ninth aspect of the invention there is provided a system for 
,5 providing printed mformation derived ftom a first party to a user where the informafion 
is obtained ftom a remote source, the system including: 

a user printer module that is provided by a second party to the user for interfacing 
to user with the source, the module being responsive to the user requesting the 
informafion from the source for obtaining the information and generating a first printed 
20 media that displays the information to the user; 

identifier means for applying an identifier to a,e first printed media such that 
designation of the identifier by tire user results in tire module generating a second printed 
media tiiat displays to ttie user additional printed information; and 
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calculation means responsive to the module for the determining a financial debit 
that is appHed by the second party against the first party. 

According to a thirtieth aspect of the invention there is provided a method for 
providing printed information derived fi-om a first party to a user where the information 
i is obtained fi-om a remote source, the method including the steps of: " 

interfacing the user with the source with a user printer module that is provided by t 
second party, the module being responsive to the user requesting the information from 
the source for obtaining the information and generating a first printed media that 
displays the information to the user; 

applying an identifier to the fu-st printed media such that designation of the 
identifier by the user results in the module generating a second printed media that 
displays to the user additional printed information; and 

being responsive to the module for the detennining a financial debit that is applied 
by tiie second party against the first party. 

These aspects, in die preferred embodiments of the invention, are directed toward 
allowing a provider of an interactive printer to receives a percentage of advertising fees, 
click-through fees, sales commissions and/or ti^ansaction fees earned directly through the 
printer. This allows a profitable role for the provider of interactive printers, and allows 
tiie provider to atti-act users by being able to partially or fixlly subsidise the capital and 
running costs of each user's printer. 

According to a thirty first aspect of the invention there is provided a system for 
providing a user with a printed pubUcation from a first party, the system including: 
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a publication source for storing publication daU representative of the publication, 
Ae publication data including first information about a second party; 
a client server for selectively accessing the publication data; 
a user printer module for interfacing the user with the server, the module being 
responsive to the user requeuing the printed publication for obtatoing .he publication 
data »d reproducing the printed publication on a print media for viewing by the user; 

identitier means for applying an identifier to the print media such that designation 
of the identifier by the user results in the module generating a second print media that 
displays to the user second information; and 

calculation means responsive to ttte module for detennining a financial debit that is 
applied by the first party against the second party. 

Preferably, the debit is a predetermined fimction of tire number of reproductions of 
the printed pubUcation ttra. are generated. In other embodiments, the second information 
is associated with the second party and the debii is a predetennined function of the 
,5 number of second print media generated. In still farther embodiments the debit is a 

predetermined fimction of both the number of printed publications generated that display 
the fir^ information and the number of second print media generated ti>at display the 
second information. 

Preferably also, the second party is a supplier of goods and/or services and the first 
20 information or flte second mformation allows the user to purchase those goods and/or 
services a. a predetermined purchase price. Preferably also, the debit is a predetermined 

function of the purchase price. 
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According to a thirty second aspect of the invention there is provided a method for 
providing a user with a printed publication from a first party, the method including the 

Steps of: 

storing publication data representative of the publication in a publication source. 
5 the publication data including first information about a second party; 

providing a cUent server for selectively accessing the publication data; 
interfacing the user with the server with a user printer module, the module being 
responsive to the user requesting the printed publication for obtaining the pubUcation 
data and reproducing the printed publication on a print media for viewing by the user; 

applying an identifier to the print media such that designation of the identifier by 
the user results in the module generating a second print media that displays to the user 
second information; and 

being responsive to the module for determining a financial debit that is applied by 
the first party against the second party. 

According to a thirty third aspect of the invention there is provided a system for 
providing a user with a printed publication from a first party, the system including: 

a publication source for storing publication data representative of the publication, 
the pubhcation data including first information about a second party; 
a client server for selectively accessing the pubhcation data; 
a user printer module for interfacing the user with the server, the module being 
responsive to the user requesting the printed publication for obtaining the publication 
data and reproducing the printed publication on a print media for viewing by the user; 
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identifier means for applying an identifier to the print media such that designation 
of the identifier by the user results in the module generating a second print media that 
displays to the user second information; and 

payment means for receiving a predetermined payment from the second party to 
5 the first party and for generating a disable signal if that payment is not made wherein the 
generation of the disable signal prevents the reproduction of the first information. 

According to a thirty fourth aspect of the invention there is provided a method for 
providingauserwithaprinted publication fromafirstparty.the method including the 

Steps of: 

storing publication data representative of the publication, the publication data 
including first information about a second party; 

selectively accessing the publication data with a client server; 
irxterfacing the user with the server with a user printer module, the module being 
responsivetotheuserrequestingtheprintedpublicationforobtainingthepublication 
rs dataandreproducingtheprintedpublicationonaprintmediaforviewingbytheuser; 

applying an identifier to the print media such that designation of the identifier by 
the user results in the module generatingasecond print media that displays to the user 

second information; 

receiving a predetermined payment from the second party to the first party; and 
generating a disable signal if that payment is not made wherein the generation of 
the disable signal prevents the reproduction of the first information. 

These aspects, in the preferred embodiments of the invention, are directed toward 
allowing a publisher who publishes on interactive paper to receive advertising fees 
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and/or click-through fees on all advertising placed within their publications, and/or sales 
commissions on all sales initiated through the advertising. This advantageously provides 
a profitable role for a publisher who pubUshes on interactive paper, and allows the 
publisher to attract readers by being able to provide them with subsidised or fi-ee 
i publications. 

According to a thirty fifth aspect of the invention there is provided a system for 
providing printed infonnation to a user that is obtained from a data base of a first party, 
the system including: 

server means for supporting the data base and storing second infonnation derived 

from a second party; 

a user printer module for interfacing the user with the server means, the module 
being responsive to the user requesting first information from the data base for obtaining 
the first infonnation and generating a first printed media that displays to the user the first 
information together with the second infonnation; 

identifier means for applying an identifier to the first printed media such that 
designation of the identifier by the user results in the module generatmg a second printed 
media that displays to the user third infonnation; and 

calculation means responsive to the module for the detennining a financial debit 
that is applied by the first party against the second party. 

According to a thirty sixth aspect of the invention there is provided a method for 
providing printed infonnation to a user that is obtained from a remote source of a first 
party, the method including the steps of: 
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supporting the data base on server means which also stores second information 

derived from a second party; 

interfacing the user with the server means with a user printer module, the module 
being responsive to the user requesting first information fi-om the data base for obtaining 
5 the first information and generating a first printed media that displays to the user the first 
information together with the second information; 

identifier means for applying an identifier to the first printed media such that 
designation of the identifier by the user results in the module generating a second printed 
media that displays to the user third information; and 

calculation means responsive to the module for the determining a financial debit 
that is applied by the first party against the second party. 

According to a thirty seventh aspect of the invention there is provided a system for 
providing printed information to a user that is obtained fi-om a data base of a first party, 

the system including: 

server means for supporting the data base and for storing first information derived 

from a second party; 

a user printer module that is provided by a second party to the user for interfacing 
the user with the server means, the module being responsive to the user requesting 
second information from the data base for obtaining the second information and 
20 generating a first printed media that displays to the user the second information together 
with the first information; 
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identifier means for applying an identifier to the first printed media such that 
designation of the identifier by the user results in the module generating a second printed 
media that displays to the user third information; and 

payment means for receiving a predetermined payment fi-om the first party to the 
5 second party and for generating a disable signal if that payment is not made wherein the 
generation of the disable signal prevents the module obtaining the second information. 

According to a thirty eighth aspect of the invention there is provided a method for 
providing printed information to a user that is obtained fi-om a data base of a first party, 
the method including the steps of: 

10 supporting the data base on server means which also stores first information 

derived from a second party; 

interfacing the user with the server means with a user printer module that is 
provided by a second party, the module being responsive to the user requesting second 
information from the data base for obtaining the second information and generating a 
15 first printed media that displays to the user the second information together with the first 
information; 

applying an identifier to the first printed media such that designation of the 
identifier by the user results in the module generating a second printed media that 
displays to the user third information; and 
20 providing payment means for receiving a predetermined payment from the first 

party to the second party and for generating a disable signal if that payment is not made 
wherein the generation of the disable signal prevents the module obtaining the second 
information. 
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These aspects, in the preferred embodiments of the invention, are directed toward 
allowing a provider of persistent storage for the logical content of interactive paper pages 
to be paid out of a global account into which a percentage of all advertising fees, click- 
through fees, sales commissions and/or transaction fees earned on printers is placed. 
5 This provides a profitable role for a persistent storage provider and allows the provision 
of page persistence to be de-coupled fi:om page publication. 

According to a thirty ninth aspect of the invention there is provided a system in 
which an account is maintained for an interactive printer. 

Preferably, the account receives credits for advertising printed on the printer. 
10 debits for the amortised capital costs and running costs of the printer, and the user of the 
printer is billed on a regular basis for any debit balance. This allows a provider to 
subsidise the capital and running costs of a user' s printer on the basis of advertising fees 
earned, while ensuring that no printer becomes a cost burden. 

According to a fortieth aspect of the invention there is provided a system in which 
15 the balance of an interactive printer account is presented to a user as a collection of 
points which, if the balance is in credit, the user redeems for special products and/or 



services. 



20 



This provides an incentive for a user to print advertising, without necessarily 
giving the user an incentive to defraud the system. 

According to a forty first aspect of the invention there is provided a system in 
which banking services are delivered via interactive paper. 

Preferably, the banking services include support for balance enquiries, account 
transfers, bill payments and loan applications. 
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According to a forty second aspect of the invention there is provided a system in 
which insurance services are dehvered via interactive paper. 

Preferably, insurance services include support for poHcy negotiation, policy issue 
and claims. 

> According to a forty third aspect of the invention there is provided a business 

model in which travel services are delivered via interactive paper. 

Preferably, travel services include support for enquiries about and reservations of 
flights, accommodation and holiday packages. 

According to a forty fourth aspect of the invention there is provided a system in 
which a publisher sells the right to be linked to one of a set of generic category buttons 
prominently featured in a periodical publication delivered on interactive paper. 

According to a forty fifth aspect of the invention there is provided a system for 
providing printed information to a user that is obtained from a data base of a first party, 
the data base having first information derived from a second party wherein the system 
includes: 

a user printer module that is provided by a third party to the user for interfacing the 
user with the data base, the module being responsive to the user requesting the fii^t 
information from the data base for obtaining the first information and generating a first 
printed media that displays to the user the first information; 

identifier means for applying an identifier to the first printed media such that 
designation of the identifier by the user results in the module generating a second printed 
media that displays to the user second information; and 
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calculation means responsive to the module for the determining a financial debit 
that is applied against the second party by the first party or the third party. 

Preferably, the calculation means determines a first and a second financial debit 
that are applied against the second party by the first and third parties respectively. 

According to a forty sixth aspect of the invention there is provided a method for 
providing printed information to a user that is obtained firom a data base of a first party, 
the data base having first information derived fi:om a second party wherein the method 

includes the steps of: 

interfacing the user with the data base with a user printer module that is provided 
by a third party, the module being responsive to the user requesting the first information 
from the data base for obtaining the first information and generating a first printed media 

that displays to the user the first information; 

applying an identifier to the first printed media such that designation of the 

identifier by the user results in the module generating a second printed media that 
displays to the user second information; and 

being responsive to the module for the detemiining a financial debit that is applied 
against the second party by the first party or the third party. 

According to a forty seventh aspect of the invention there is provided a system for 
providing printed information to a user that is obtained from a data base of a first party. 
0 the data base having first information derived from a second party wherein the system 
includes: 

a user printer module that is provided by a third party to the user for interfacing the 
user with the data base, the module being responsive to the user requesting second 
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infonnation from the data base for obtaining the second information and generating a 
first printed media that displays to the user the second information together with the first 
information; 

identifier means for applying an identifier to the first printed media such that 
■> designation of the identifier by the user results in the module generating a second printed 
media that displays to the user third infonnation; and 

calculation means responsive to the module for the determining a financial debit 
that is apphed against the second party by the first party or the third party. 

According to a forty eighth aspect of the invention there is provided a method for 
providing printed information to a user that is obtained from a data base of a first party, 
the data base having first information derived from a second party wherein the method 
includes the steps of: 

interfacing the user with the data base with a user printer module that is provided 
by a third party, the module being responsive to the user requesting second information 
from the data base for obtaining the second information and generating a first printed 
media that displays to the user the second infonnation together with the first 
information; 

applying an identifier to the first printed media such that designation of the 
identifier by the user results in the module generating a second printed media that 
displays to the user third infonnation; and 

being responsive to the module for the detennining a financial debit that is applied 
against the second party by the first party or the third party. 
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Preferred embodiments of the above aspects of the invention, together with other 
aspects, will now be described, by way of example only, with reference to the following 
Appendices which are identified as: 

Netpage, System Overview, draft version 0.4; 
Netpage Printer, Design Description, draft version 0.3; 
Netpage Pen, Design Description, draft version 0.3; 
Netpage, Applications, draft version 0.2; 
Netpage, Extensions, draft version 0.1 ; and 
Self-Mapping Surfaces, Design Description, draft version 0.2. 
Although the inventions have been described with reference to specific examples it 
will be appreciated by those skilled in the art that they may be embodied in many other 
forms. 

DATED this 25th day of October, 1999 
SILVERBROOK RESEARCH PTY LTD 

Attorney: JOHN B. REDFERN 
Fellow Institute of Patent Attorneys of Australia 
of Baldwin Shelston Waters 
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Introduction 



Netpages are pages of high-quality text, graphics and images printed on ordinary 
paper, but which work almost like interactive Web pages. Information encoded on 
each page in invisible ink is picked up by an optically-imaging pen and transmitted 
to the network. Active "links" and "buttons" on each page can be "pressed" with 
the pen to request information from the network or signal preferences to a server. 
Text written by hand on a Netpage is automatically recognized via the pen, 
allowing forms to be filled in. Signatures recorded on a Netpage are automati- 
cally verified, allowing e-commerce transactions to be securely authorized. 



The pen, shown on the right, works in conjunction with a Netpage Printer, an / Jf 
Internet-connected printing appliance for home, office or mobile use. The L ^ 
pen is wireless and communicates with the Netpage Printer using an ~^ 
encrypted radio frequency signal. 

The Netpage Printer delivers, periodically or on demand, personalized newspapers, maga- 
zines, catalogs, brochures and other publications, all printed at high quality as interactive 
Netpages. Unlike a personal computer, the Netpage Printer, shown on the right, is an 
appliance typically wall-mounted in the kitchen or near the breakfast table, i.e. the place 
where the morning news is first consumed, and the household's point of departure for the 
day. It also comes in tabletop, desktop, portable and miniature versions. 

Netpages printed at their point of consumption combine the ease-of-use 
of paper with the timeliness and interactivity of an interactive medium. 

Netpages are crucially enabled by Memjet printing technology [2], 
which makes high-speed magazine-quality printing affordable to con- 
sumers. A Netpage publication has the physical characteristics of a tradi- 
tional newsmagazine, i.e. a set of letter-size glossy pages printed in full 
color on both sides, bound together for easy navigation and comfortable 
handling. The Netpage Printer prints 60 to 90 frill-color Netpages per 
minute. 

The Netpage Printer exploits the growing availability of broadband Inter- 
net access. Cable service is available to 95% of households in the United 
States [57], and cable modem service offering broadband Internet access 
is already available to 20% of these [9]. The Netpage Printer also oper- 
ates with slower connections, but with longer delivery times and lower 
image quality. 

Netpage Publication Servers on the Internet deliver print-quality publica- 
tions to Netpage Printers. Periodical publications are delivered automati- 
cally to subscribing Netpage Printers via pointcasting and multicasting 
Internet protocols. Personalized publications are filtered and formatted 
according to individual user profiles. 

A Netpage Printer supports any number of pens, and a pen can work with any number of 
Netpage Printers. Each Netpage Pen has a unique identifier. A household may have a col- 
lection of colored Netpage Pens, one assigned to each member of the family. This allows 
each user to maintain a distinct profile with respect to a Netpage Publication Server. A 
Netpage Pen can also be registered with a Netpage Registration Server and linked to one 
or more payment card accounts. This allows e-commerce payments to be securely autho- 
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rized using the Netpage Pen. The Netpage Registration Server compares the signature cap- 
tured by the Netpage Pen with a previously registered signature, allowing it to authenticate 
the user's identity to the e-commerce system. Other biometrics can also be used to verify 
Identity. A version of the Netpage Pen includes fingerprint scanning, verified in a similar 
way by the Netpage Registration Server. 

Although a Netpage Printer delivers periodicals such as the morning newspaper without 
user intervention, it never delivers unsolicited junk mail. It only delivers periodicals from 
subscribed or othenvise authorized sources. The Netpage Printer is unlike a fax machine 
or e-mail account which is visible to any junk mailer who knows the telephone number or 
email address. 



1.1 Publishing to Netpage Printers 

There are a number of advantages to publishing to Netpage Printers. The magazine quality 
of Netpage Printer output makes it a more attractive publishing and advertising medium 
than both traditional newsprint and computer screens. 

The cost of paper and ink consumption is transferred to the user. Subscription fees can be 
eliminated entirely in lieu of the user taking on this extra cost, and the user thus perceives 
a better-value product. The erratic price of newsprint is removed from publishers' profit 
equations, resulting in more stable margins. A new market for paper and ink consumables, 
with its own margins, is created. 

The cost of consumables can be selectively subsidized, for example when non-editorial 
publications such as product brochures and account statements are printed. 

Capital and maintenance expenditure on printing plant is effectively transferred to the 
user, although the perceived expense is small because Netpage Printers are sold at close to 
cost or given away to encourage adoption, subsidized by future advertising profits. Main- 
tenance can also be subsidized or its cost included in a longer term service agreement. 

Costly physical distribution is replaced by electronic distribution via a preexisting and 
widely subscribed network - the Internet. 

Both the editorial and advertising content of publications delivered via the Netpage Net- 
work can be customized for each user. Editorial content can be personalized according to 
the user's profile. Advertising can be localized to the user's locality and optionally tar- 
geted to the user's demographic. 

A personalized publication can be a small fraction of the size of its traditionally-delivered 
counterpart, yet contain the same amount of information relevant to the user, and in a more 
accessible form. The user appreciates the more efficient and digestible publication. 

Localized advertising can be targeted to more specific localities and their associated 
demographics, and this allows advertising space to be exploited more efficiently, i.e. with 
less waste. Advertisers are constantly pressing traditional publishers for greater' localiza- 
tion, something which they have great difficulty delivering cost-effectively. 

By revealing personal information such as age, gender, marital status, income, profession, 
education, etc., the user can allow the advertising to be more carefully targeted. In return 
they can receive greater subsidies and discounted product offers. As advertising becomes 
more targeted, it becomes less of a nuisance and more of a service in itself. 
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Although the publication's per-page circulation figures fall drastically, the publication's 
actual per-section readership is preserved, and the correspondingly higher advertising 
rates for personalized delivery can exactly compensate for this. 

Advertising delivered via the Netpage Network has the dual benefits of print and online 
delivery. Print supports the impact of large-fonnat ads. Online delivery supports customi- 
zation, linking, and measurability, and consequently online charging models. 

Consider a full-page advertisement for a new car model in a newsmagazine delivered via 
the Netpage Network. The advertising campaign can be national or even international. 
The ad only appears if compatible with the user's demographic, either implied by their 
ZIP Code or more explicitly by their personal details. Anyone who requests a product bro- 
chure via the on-ad button receives one immediately via their Netpage Printer, customized 
with a list of local dealers. If they press a particular dealer's "contact me" button in the 
brochure, the dealer receives a message via the system and contacts the user by telephone. 

The publisher profits in the normal way by selling the advertising space, but can also 
profit by receiving a fee on the "click-through" to the brochure, and a commission on any 
product sale which eventuates. 

The Netpage Network promises to be the most effective advertising medium ever con- 
ceived- It combines the editorial and print quality of traditional publications with arbi- 
trarily finely targeted advertising, and provides a direct link between advertising, product 
information, and purchasing. Added revenue from click-through fees and e-commerce 
commissions may even allow users' costs - printer, ink, paper, and Internet access - to be 
fully subsidized. 
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2 The Demise of Paper 

t^eoonc""''"*:^"*'" ''^'.'"'"^ advantages over traditional paper-based publication. From 

Lted vrnrr'?','? ^^^"^•"^ °" ''"^^^^^ ^e uZ 

X pe'sonaS ' " ''^ 

fnTted ^?H"^h '^'"■k,''*''"' ° u^''^' ^"'^ Pl^y^'^^' distribution are elim- 

be ' 1 " '^l P"''''"'r ''^'^o'^es more attractive to the advertisers who pay for it 
because .t can be targeted to specific demographics and linked to product sites. 

At"!he?ami'r'rr"° ' disadvantages. Computer screens are inferior to paper. 

^fti L Z.h^ f ^ ' "JT'T P'^"' '^"'"P"'^^ ^"^^^^^ displays only aboEt a 

fifth as much .nfonnat.on'. Both CRTs and LCDs have brightness and contrast problems 

sive, IS both bright and sharp in ambient light. 

Stoorint ifh"r°''' '""T"' °" ^ "^^^ people 

prefer to print .t before readmg .t. Increasingly, online publishers are recognizino this and 

Z^t'ZnllTeT "fT "'^"^ P'"''"^- ^"'--^ this'meanVpLTd 

cfeenti 7h ^'^"'"^"'^ ^° *ey print efficiently, i.e. without imposing a 

screen format on the prmted page; at the other extreme it means providing formatted ver- 

hlgMua^^"""'^ ■ ^'^"^'^ "^-^^"'^ ^"•^"'"-^ Fon.at%DF) -%o t™; print "t 

Die wh^ "I"" compromised to fit the online medium and the habits of the peo- 

ple who frequent .t, who tend to browse rather than read. Although powerful new advertis- 
ing models become possible, it becomes more difficult to deliver eff-ective advertisements. 

IncTirt^^' °f publication, many people envisage a universal information appli- 
hi'h ^andSir" r^'"' ' "'^^"'^ touch-sensitive color display and a 

kIv in the m 5 ^ot^" <=o"neet,on to the Internet. First proposed by Xerox PARC^ Alan 
Kay m the m.d 1970s m the form of the "Dynabook", and partially realized in recent 

IT:^ T '"'"""^ "^^'^ confidently predicting a such 

a device will soon augur the death ofpaper publications [25]. 

To achieve low power consumption, low weight, and paper-like display quality, a bistable 
eflecfve d.splay technology is required. Several candidates are now em erg .^^i from the 
lab mc udmg Kent Display's cholesteric LCD technology (chLCD) [36], lerox' "Syri- 
con rotatmg ba I technology [28], and E Ink's electrophoretic tLJnology [21 47 . 
ChLCD IS arguably closest to practical deployment [20]. 

bir/ofhrr'TK"!,'"'^'' "^""^ "^'"^^'^^ P™"'*'^ 2'^^P' P^cl'et switching [22], compara- 
wtks wSr ^""'"^ """^ '° ^"'"^ f^4]. Satellite net- 

dTmcu'ltTotpl^^^m^^l^^^^^^^^^^^^^^ '''^''^''^^ 

Beyond the vision of the basic tablet. E Ink imagines its digital ink "printed" onto a num- 
ber of flexible pages bound into a book, preserving the physical navigability of a 
paper-based publication, and approaching its low cost, but allowing the pages to be rewrit- 



1. Assuming a magazine page has an equivalent digital resolution or200 continuous-tone pixels per inch. 
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ten electronically in place. They optimistically predict newspapers delivered in this way 
within five years [16], despite fundamental problems yet to be overcome [20]. 

The advantages of a tablet are many. Unlike a desktop or notebook computer, a tablet may 
actually provide a pleasant reading experience. Unlike a paper publication, a tablet pro- 
vides intelligent access to an unlimited amount of information; its weight is not dictated 
by the amount of information it carries. More than just an information appliance, it can 
also act as a multi-purpose multimedia communications device and interactive entertain- 
ment device. 

A tablet has disadvantages too. It uses batteries which run down and have to be recharged. 
It may break when dropped or malfunction when exposed to hot coffee. It's not quite 
cheap enough to be disposable - so there's still a problem if it's misplaced or stolen. It has 
a "user interface" which has to be learned. The leading candidate display technology - 
chLCD - is still less than half as reflective (i.e. "bright") as paper. 

The drawbacks of traditional paper-based publications have little to do with paper itself, 
and much to do with how the information gets onto the printed page. The economics of 
centralized printing and distribution prevent the kind of information selection, personal- 
ization and navigation people have come to expect fi-om interactive electronic media such 
as the Internet. The inefficiency of printing and distributing a hundred-page newspaper to 
a customer who may read only a few pages is widely decried. 

Given a technology such as Memjet, it becomes economic to print high-quality publica- 
tions at their point of consumption rather than at their point of production. The Netpage 
Printer leverages Memjet to deliver personalized publications to the home, gaining many 
of the advantages of online publication, while retaining the ease-of-use of high-quality 
printed ink on paper. 

Netpages and the Netpage Printer address the key problems of online publication, without 
relying on the development and consumer acceptance of a new reading device. 
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3 News and Advertising Trends 

3.1 Newspapers 

People obtain news from a variety of sources - networlc and cable television, radio daily 
newspapers, and weekly newsmagazines. In the United States, although the various' news 
media are healthy and profitable, per capita news consumption is somewhat in decline as a 
new generation of young adults have less time to read and favor television entertainment 
over news [ 1 7]. Yet six out of ten adult Americans read a newspaper every day [53]. 

The United States has about 1500 daily newspapers with a total circulation of 57 million 
Just the top ten "national" dailies (Wall Street Journal, USA Today, New York Times Los 
Angeles Times, Washington Post, etc.) account for a circulation of 1 0 million. The major 
weekly newsmagazines (Time, Newsweek, U.S. News) have a similar (weekly) circula- 
tion of about 10 million. 

In 1997, newspaper companies' revenue exceeded $24 billion, a five-year high and mar- 
gms nudged 20% [39], due both to increased spending on advertising and to reduced 
prices of newsprint. 

Television and radio, by their nature, excel at delivering breaking news. Newspapers and 
newsmagazines, on the other hand, deliver the depth and analysis behind the headlines 
Broadcast news in isolation does a poor job of informing the public. The more local the 
news IS, the poorer the broadcast coverage, and the greater the public's dependence on 
newspapers. 

Newspaper content and packaging has evolved considerably since the 1970s. News is 
somewhat softer, news stories are shorter and more well-written, there are more feature 
articles, and there is more editorial and reader opinion. Newspapers are more structured 
Identifiable sections make them more accessible, and provide greater focus for advertis- 
ers. Much special-interest content has migrated from daily inclusion to weekly sections. 
These cover topics such as lifestyle, personal finance, entertainment, technology, etc. The 
proportion of graphics and pictures is greater. Color is widely used. Newspapers are easier 
to use and more entertaining than ever before, if at the expense of some "hard" news. 

Daily newspapers are growing increasingly dependent on the various wire services A 
newspaper may excel at local and regional news, but rely on the major wires (Associated 
Press and Unrted Press International) for national and international news, the so-called 
"supplemental" wires (LA Times/Washington Post, NY Times, Scripps-Howard, 
Knight-Ridder Tribune, etc.) for specific strengths (and value-for-money), and the interna- 
tional wires (Reuters etc.) for international perspective. A growing number of newspapers 
operate more as news aggregators than news gatherers. 

Advertising typically contributes more than 75% of newspaper and magazine revenue, 
while subscriptions contribute less than 25% [27,51,52]. National advertising makes up 
roughly 14% of advertising spending, retail advertising 46%, and classified advertising 
40% [52]. 

Advertisers are pursuing increasingly specific targeting, favoring quality newspaper read- 
ership over raw circulation [24], and using more targeted media where possible. Maga- 
zines, for example, have more specific readerships than newspapers, free "shoppers" are 
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very localized by their nature, while direct mailers can target demographics based on indi- 
vidually-categorized ZIP Codes, or databases of individuals. 

Newspapers have responded with geographically zoned editions to support local advertis- 
ing, and greater sectioning of their product. They have also expanded their page counts to 
provide more advertising scope, despite erratic newsprint prices in the 1990s [5]. 

Despite this, there is ongoing conflict between newspapers' mass distribution model, and 
advertisers' need for micro-targeting [26]. This conflict, coupled with advertisers' desire 
for higher-quality printing of color images, is motivating a shift from run-of-press (ROP) 
advertising to inserts [52]. The downside to inserts is that editorial context is lost. 



Fearing the online migration of advertising, traditional news publishers from both broad- 
cast and print have ventured into Internet-based news delivery, wanting to establish a pres- 
ence at whatever cost before newcomers become entrenched. Most newspapers are still 
reporting losses from their online operations [52]. 

Online news delivery offers a number of advantages. Breaking news can be delivered as 
soon as it happens. News can be customized for individual readers according to their pref- 
erences and geographic locations. Readers can explore stories to arbitrary depth, follow 
links to related resources, and search archival material. Readers can participate in discus- 
sion groups and contribute to opinion polls. The news itself can incorporate audio and 
video clips, and can include live transmissions, converging with broadcast. 

Online news delivery also has disadvantages. Computer screens are of limited size and 
quality compared with print. Few people enjoy reading a story of any length on a com- 
puter screen. Computers are not portable in the wide sense that a newspaper is. The news 
may be more timely, but the time and place in which it can be consumed are more con- 
strained than with a newspaper. 

Despite the power of hypertext, many online readers express a preference for a linear pre- 
sentation, "where they [can] skim one section after another until the presentation [is] 
exhausted" [II]. Interestingly, a majority of traditional. newspaper readers admit they scan 
every page in the main section of the newspaper [53], looking for items of interest without 
necessarily knowing what they're looking for, and achieving some kind of closure at the 
end. Online hypertext, by contrast, is both a limitless resource and a bottomless pit. 

While traditional news publishers such as The New York Times can deploy full editorial 
content online [64], newcomers such as Yahoo typically only provide "raw" news items 
sourced fi'om the wire services [48]. 

A recent survey indicates that 21% of the 74 million Internet users in the United States 
regularly read news online as an alternative to traditional print and broadcast sources, and 
16% obtain a major proportion of their news online [54]. More broadly, between 37% and 
64% of the Internet population reads news online at least once a week. The fluctuations in 
the figures are related to what may be happening in the news. Major or breaking news sto- 
ries attract more users - 46% of Americans say they only follow national news stories 
when "something major is happening" [23]. 

With 41% of Americans online, the Internet population has become mainstream, and the 
weather has become the most popular news online. This is closely followed by technology 
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3.4 



Online Classified Advertising 



Classified advertising is indisputably suited to online delivery. Unlike their traditional 
printed counterparts, online classifieds can be easily searched, and are not subject to space 
constraints. The online migration of classified advertising is considered a serious threat to 
newspapers' classified advertising profits [60], and some newspapers are building an 
online presence for this reason alone. Some observers predict as much as 50% of classified 
advertising revenue moving online within the next ten years [72]. 

Another problem faced by newspapers, who rely on classifieds for up to 40% of advertis- 
ing spending, is that many newcomers are offering free online classified advertising as a 
way of building a venue for non-classified advertising. 
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4 News Personalization 

From the reader's point of view, a personalized news publication can provide more infor- 
mation in fewer pages. The actual form this personalization takes, however, is not neces- 
sarily obvious. 

The MIT Media Lab's News in the Future (NiF) project has been championing the concept 
of 'The Daily Me" for almost two decades [45]. Nicholas Negroponte, one of the project's 
founders, envisages a highly personalized news publication which is no longer driven by 
"what other people think is news" [49]. By way of examples close to his own needs, it 
mcludes news about people and places about to be encountered, and puts "the most impor- 
tant [news] of all" - a summary of e-mail - on the front page [7]. Negroponte recognizes 
the need to vary the degree of personalization, advocating a higher "serendipity factor" on 
a lazy Sunday than on a working weekday. 

The opposing view holds that the value of a news publication lies precisely in its shared 
nature. It reflects the common concerns and values of a community of readers, and estab- 
lishes a baseline of expectations of what they are all supposed to know [67]. As a conse- 
quence, the publication also speaks with a consistent editorial voice and with consistent 
assumptions about the reader's level of background knowledge. Such a shared publication 
allows its readers to orient themselves in relation to their community. 

NiF's Walter Bender answers the chai^ge (in his own words) of "The Daily Me engender- 
ing a fragmented world populated by self-interested myopes", by stressing the possibilities 
of personalizing individual news items [6]. This can consist in varying the depth of an 
Item, or supplementing it with background information, based on the reader's level of 
knowledge. It can involve interpreting information relative to the reader's background, 
such as (somewhat dubiously) making value judgements about the weather relative to the 
reader's normal home town weather. It can also be as simple as using metric rather than 
imperial units. 

Fish Wrap [1 1,46], MIT's personalized campus newspaper and NiF's latest offering, goes 
further by creating a front page whose content represents an explicit community consen- 
sus. Each front page news item is prioritized according to the number of readers who put it 
forward for inclusion. The rest of the newspaper is still personalized according to each 
reader's profile, consisting of reader-defined sections containing topics of interest. 

There are two implications of recognizing the shared nature of news. Firstly, some news is 
news to everybody in a community, no matter how personalized they claim they would 
like their news to be. This implies that the community must make decisions about news 
item priority, either directly (as in Fish Wrap) or indirectly via a proxy (i.e. an editor). 

Secondly, a news item can only be properly understood in the context of the community 
for which it is intended. This implies that a news item must be branded with its source 
(assuming that the source implies the intended target). As an example, it is significant 
whether a news item regarding the proof of Fermat's last theorem is branded with New 
Scientist or The New York Times. To a professional mathematician, the latter implies, by 
its very existence, that the proof is of significance beyond the scientific community. 

Of course, a news item must also be branded to allow its source to build and maintain its 
brand. The brand then allows the reader to infer the quality of the news item from the 
known quality of the source. 
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Most personalization of news uses feature-based filtering. This means that news item con- 
tent is matched to topics and keywords in the reader's profile. News sources tag the items 
they produce with various information to allow them to be effectively filtered. This tag- 
ging may be brief or extensive, and may include such things as news item urgency, byline, 
news category, subject(s), keyword(s), date and time, and location [33]. The body text of a 
news item can also be scanned directly for keywords, but this may result in false matches 
if keywords are interpreted out of context. Items in the text such as personal names and 
locations can be tagged to reduce such ambiguity [33]. Similarly, dates, times, and mone- 
tary amounts can be tagged to allow localized presentation. 

Feature-based filtering suffers from a number of problems. Filtering based on tags is only 
as good as the original tagging. The latest tagging standards are only just beginning to be 
adopted [8]. Filtering based on the text itself is constrained by the intelligence of the text 
parsing. If based simply on keyword matching, it can be both inaccurate, generating false 
matches because of word sense ambiguity, and imprecise, generating false mismatches 
because of a lack of inference. 

Feature-based filtering is incapable of discerning more abstract anributes such as quality, 
style, and point-of-view (unless they're indicated by tags). And since it only matches 
items anticipated by the user's profile, it is a poor generator of serendipitous finds. 

FishWrap's front page comes into existence based on a crude form of collaborative filter- 
ing. In its broader form, collaborative filtering involves sharing recommendations (or rat- 
ings) among like-minded people [56]. This means that one person's ratings influence 
another person if and only if the two share similar interests, i.e. they have similar rating 
histories. Collaborative filtering overcomes many of the problems of feature-based filter- 
ing, since ratings originate with people who have digested the items in question, rather 
than from automated analysis of the items. Collaborative filtering sidesteps the issue of 
explaining why a person might like a particular item. 

Collaborative filtering has problems of its own. The system only works if people are will- 
ing to contribute ratings. In contributing ratings, of course, they are both doing the com- 
munity a service and tuning their own interest profiles. The statistical error in correlating 
people's interests decreases as the number of ratings increases. However, incentives may 
have to be offered to encourage people to contribute ratings. 

To bootstrap the accumulation of ratings for new items, an independent mechanism must 
exist to distribute them to a critical mass of people. Conversely, to bootstrap the accumula- 
tion of interest profiles for new users, an independent mechanism must exist to distribute a 
critical mass of items to them. 

To allow meaningful accumulation of ratings, a sufficient period of time must be allowed 
to elapse. This may conflict with the timely delivery of items in question. 

The statistical correlation between different people's interests, represented by their rating 
histories, is most meaningful when the ratings apply to homogeneous items. For a set of 
heterogeneous items, collaborative filtering is best applied to homogeneous subsets. 

In a news setting, collaborative filtering is best applied to feature articles. Features have 
the longer life span required to support the accumulation of ratings, and are often appreci- 
ated for abstract qualities best singled out by collaborative filtering (good writing, humor, 
incisiveness, etc.). 
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Naturally, the larger a publication's readership, and the better its taste in relation to a 
potential reader, the stronger the publication's brand will appear to that reader. 

Although it's easy to become preoccupied with automatic filtering, in reality there's more 
to editing the news than just filtering news feeds. An editor also solicits news, commis- 
sions analysis, and offers opinion, ideally ensuring that the publication offers a balanced 
and complete view of the world. 

Perhaps the most important personalization step a reader takes is in selecting a particular 
publication from a set of available publications, based on its perceived quality and rele- 
vance. 



Thus the publication's brand equates to the highest-level and most useful filter of ail. 
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5 Netpage System Architecture 



5.1 The Internet 



The Internet is a worldwide collection of interconnected networks which communicate 
usmg the TCP/IP protocol suite [59]. A TCP/IP-based internetwork not connected to the 
Internet is often referred to as an internet (i.e. with a lower-case M'). When an internet is 
deployed within an organization, it is often termed an intranet. 

Access to the Internet is widespread in developed countries. In the United States, for 
example, 41% of the population has access to the Internet [54]. 

While most consumers still access the Internet via low-speed dial-up modems connected 
to the switched telephone system, inexpensive broadband access is becoming available to 
a growing number of households via the cable networks. Cable service is available to 95% 
of American households [57], and cable modem sei^ice is available to a 20% subset [9] 
While dial-up modems offer speeds of up to 56Kbps, cable modems offer practical speeds 
of up to about 3 Mbps', i.e. over 50 times faster. 

DSL (Digital Subscriber Line) [12,13], while offering similar speeds to cable modems but 
via the telephone system, is not yet widely used. ISDN (Integrated Services Digital Net- 
work), although widely used for corporate access, has had little consumer impact due to its 
nigh price and comparatively low performance. 

The deployment of third-generation (3G) cellular telephony within the next few years will 
bring practical mobile broadband speeds of 2Mbps [22]. 3G cellular uses WCDMA (wide- 
band code-division multiple access), a spread-spectrum technology. Satellite systems are 
arguably closer to offering even faster broadband Internet access [29,50,63]. 

The core of the Internet is made up of a number of independent high-speed fiber-optic net- 
works connected into NAPs (Network Access Points) or peered directly. These have until 
recently used single-wavelength TDM (Time-Division Multiplexing) SONET (Synchro- 
nous Optical Network) transmission systems which utilize about 1% of an optic fiber's 
capacity to yield a 2.5Gbps OC-48 channel^. Carriers are now beginning to deploy 
multi-wavelength DWDM (Dense Wavelength-Division Multiplexing) systems which 
yield up to 40 such channels per optic fiber, thus increasing network capacity significantly 
without requiring the laying of more fiber [10,40]. Internet architects are therefore now 
contemplating aggregate capacity in the terabit (Tbps) range. 

The Internet uses the four-layer TCP/IP protocol suite. The application layer provides var- 
ious end-to-end application services, and is a client of the transport layer which provides 
end-to-end delivery services. The transport layer in turn is a client of the network layer 
which provides packet routing. The network layer is a client of the link layer which encap- 
sulates specifics of the protocols and hardware of the actual communications links. 

The core Internet transport protocol, TCP (Transmission Control Protocol), provides a 
reliable end-to-end delivery service. The core Internet network protocol, IP (Internet Pro- 
tocol), provides an unreliable and connectionless packet routing service. IP may lose or 



I. Although the cable supports 30Mbps and the cable modem theoretically supports 10Mbps. 

^' uS2!I15Z'Smk " ^O^^fif «'on. ^here OC stands for Optical Carrier, and n gives the channel speed in 
unite of about 52Mbps. An OC^8 channel therefor* has a speed of about 2.5Gbps. 
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deliberately discard packets, and may deliver packets out of order, and it is the responsibil- 
ity of a higher layer to provide a reliable end-to-end service. 

With the proliferation of streaming media services on the Internet, support for multicast is 
spreading rapidly. Multicast is a form of broadcast with a specific set of recipients. It 
makes efficient use of network capacity because a packet traverses a network link once 
rather than once per recipient. It is particularly efficient if the recipients are connected to 
the Internet via an intrinsically broadcast medium such as cable or satellite. The @Home 
cable network has successfully enabled multicasting of streaming media services [38]. 

IP Multicast is an extension of IP, and so is unreliable. While this is often acceptable for 
time-critical data such as streaming video, it may not be acceptable for other shared data 
types. Significant effort is being expended to develop reliable multicast transport proto- 
cols on top of IP Multicast, Although several reliable multicast protocols are available and 
have been deployed [41,42,30,31], the Internet standardization process is incomplete [32]. 



5.2 



Netpages and Netpage Documents 



Netpages are the foundation on which a Netpage Network is built. They provide a 
paper-based user interface to published information and interactive services. 
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Figure 1. Netpage Document structure (* indicates an n-ary relationship) 
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Each Netpage consists of a compact page layout maintained persistently by a Netpage 
Page Server. The page layout refers to objects such as images, fonts and pieces of text, 
typically stored elsewhere on the Netpage Network. 

Netpages are organized into Netpage Documents, Both Netpages and Netpage Documents 
are assigned globally unique identifiers. 

Each Netpage Document has a set of document instances, each of which describes a 
printed instance of the document. Each Netpage in the Netpage Document has a corre- 
sponding set of page instances, each of which describes a printed instance of the page. 
Both page instances and document instances are assigned globally unique identifiers. 
They are also uniquely associated with the printer on which they are printed and the user 
who initiated the print request, if known. 

Each page instance maintains a set of user-supplied values for fields in the page layout. 
This ensures that user input is captured and stored independently for each page instance. 
The separation of page instances and Netpages is crucial for pages which contain input 
fields, i.e. forms. It is not crucial for pages devoid of input fields, but still useful because it 
supports independent auditing of each page instance. 

The physical page image includes encoded information which identifies the page instance 
and hence the Netpage to which it corresponds. It also includes encoded information 
which superimposes an addressable spatial grid over the page image, to allow pen actions 
performed relative to the page image to be correlated with the contents of the page layout. 

The encoded information is normally printed in infrared-absorptive ink on any normal 
paper substrate which is infrared-reflective. Near-infrared wavelengths are invisible to the 
human eye but are easily sensed by a solid-state image sensor with an appropriate filter. 

The encoded information is picked up by an infrared-imaging pen and transmitted to the 
associated Netpage Printer. The pen is wireless and communicates with the Netpage 
Printer using an encrypted radio frequency signal. 

The encoded information is organized as a set of tags, each containing both the id of the 
page instance and the position of the tag. The tags tile the entire page image, and are suffi- 
ciently small and densely arranged that the pen can reliably image at least one tag even on 
a single click on the page. It is important that the pen recognize the page instance id and 
position on every interaction with the page, since the interaction is stateless. 

The tags are error-correctably encoded to make them resilient to errors introduced by dirt 
on the page or during the imaging process. 

Memjet-based Netpage Printers are designed to print a tag grid using infrared (IR) ink. 
Printers not enabled for IR printing have the option to print tags using IR-absorptive black 
ink, although this restricts tags to otherwise empty areas of the page. Although such pages 
have more limited ftinctionality than IR-printed pages, they are still classed as Netpages. 



A Netpage Network consists of a distributed set of Netpage Publication Servers, Netpage 
Page Servers, and Netpage Printers connected via an internet. In technological terms this 
document describes any Netpage Network. In business terms it usually refers to the 
Netpage Network connected via the Internet. 



5.3 
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As described above, a Netpage Page Server maintains persistent information about 
Netpage Documents, Netpages, and their printed instances, to allow pen operations on 
printed pages to be interpreted intelligently. 

The Netpage Network includes any number of Netpage Page Servers, each handling a sub- 
set of Netpages. As described above, each page instance is identified by a globally unique 
id which is encoded in the tag grid of the corresponding printed page. The Netpage Printer 
uses this id to retrieve the page layout of the page from a Netpage Page Server when it 
needs to interpret pen operations relative to the page. 

The Netpage Printer uses the internet Distributed Name System (DNS) to resolve a 
Netpage instance id into a page instance maintained by a particular Netpage Page Server. 

The DNS is a protocol and a hierarchical system of name servers used to resolve internet 
domain names into resources. Planned enhancements to the DNS allow it to be used to 
resolve more general Uniform Resource Identifiers (URls), and in particular Uniform 
Resource Names (URNs), into resource locations [19]. Netpage instance ids are formu- 
lated as URNs, allowing the enhanced DNS to be used to resolve them. In the absence of 
timely standardization and deployment of an enhanced DNS on the Internet, the Netpage 
Network can deploy its own system of enhanced name servers. 

A Netpage Publication Server is an intemet server which publishes Netpage Documents to 
Netpage Printers. It is described in Section 6. 



The Netpage Printer is the appliance which prints Netpage Documents. It is connected to a 
Netpage Network via an intemet, ideally via a broadband connection. 

Apart from identity and security settings in non- volatile memory, the Netpage Printer con- 
tains no persistent storage. As far as a user is concerned, the network is the computer [61]. 
Netpages function interactively across space and time with the help of the distributed 
Netpage Page Servers, independently of particular Netpage Printers. 

The Netpage Printer receives Netpage Documents from Netpage Publication Servers. 
Each document is distributed in two parts: the page layouts, and the actual text and image 
objects which populate the pages. Because of personalization, page layouts are typically 
specific to a particular subscriber and so are pointcast to the subscriber's printer. Text and 
image objects, on the other hand, are typically shared with other subscribers, and so are 
multicast to all subscribers' printers. 

The Netpage Publication Server optimizes the segmentation of document content into 
pointcasts and multicasts. After receiving the pointcast of a document's page layouts, the 
printer knows which multicasts, if any, to listen to. 

Once the printer has received the entire document's page descriptions, i.e. page layouts 
and objects, it can print the document. 

The printer rasterizes and prints odd and even pages simultaneously on both sides of the 
sheet. It therefore contains duplexed print engines and imaging units. 

The printing process consists of two decoupled stages: rasterization of page descriptions, 
and expansion and printing of page images. The raster image processor (RIP) consists of 
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5.5 



The Netpage Pen 



The Netpage Pen operates both as a normal marking ink pen and as a non-marking stylus. 
When either nib is in contact with a Netpage, the pen continuously monitors its move- 
ments relative to the page. The nib is attached to a pressure sensor. The pen pressure can 
be interpreted relative to a threshold to indicate whether the pen is "up" or "down". It can 
also be interpreted as a continuous value, for example when the pen is capturing a signa- 
ture, to allow the full dynamics of the signature to be verified. 

The pen determines the position of its nib on the Netpage by imaging, in the infrared spec- 
trum, an area of the page in the vicinity of the nib. It decodes the nearest page id and posi- 
tion tag, and adjusts the position given by the tag to account for the distance between the 
area imaged and the actual nib, and the position of the tag in the imaged area. Although 
the position resolution of the tag may be low, because the tag density on the page is 
inversely proportional to the tag size, the adjusted position resolution is quite high, and 
easily exceeds the minimum 200 dpi resolution required for handwriting recognition [62]. 

Pen actions relative to a Netpage consist of a series of strokes. A stroke consists of a 
sequence of time-stamped pen positions on the page, initiated by a pen-down event and 
completed by the subsequent pen-up event. A stroke is also tagged with the page id of the 
Netpage whenever the page id changes, i.e. just at the start of the stroke under normal cir- 
cumstances. 

The position tags on the Netpage contain various control bits. One of these instructs the 
pen to activate its "active area" LED. Thus a region on the page which corresponds to the 
active area of a button or hyperlink can be encoded to activate this LED, giving the user 
visual feedback that the button or hyperlink is active when the pen passes over it. Another 
control bit instructs the pen to capture continuous pen pressure readings and tag the stroke 
with these readings. Thus a region on the page which corresponds to a signature input area 
can be encoded to capture continuous pen pressure. 

Whenever the pen is within range of a printer with which it can communicate, the pen 
slowly flashes its "online" LED. When the pen fails to decode a stroke relative to the page, 
it momentarily activates its "error" LED. When the pen succeeds in decoding a stroke rel- 
ative to the page, it momentarily activates its "ok" LED. 

The pen also contains a pair of passive. accelerometers mounted at right angles to each 
other in the plane normal to the pen's axis. The accelerometers respond to gravity and 
allow the pen to compute its tilt. This in turn helps it auto-focus its optics and compute the 
nib-to-tag displacement. If the stroke is being tagged with pen pressure readings, then it is 
also tagged with tilt readings. 

A sequence of captured strokes, whether tagged with pen pressure and tilt or not, is 
referred to as digital ink. Digital ink forms the basis for the digital exchange of drawings 
and handwriting, for on-line recognition of handwriting [62], and for on-line verification 
of signatures. 

The pen is wireless and transmits digital ink to the Netpage Printer using a radio frequency 
signal. The digital ink data is encrypted for security and packetized for efficient transmis- 
sion, but is always flushed on a pen-up event to ensure timely handling in the printer. 

When the pen is out-of-range of a printer it buffers digital ink in internal memory, which 
has a capacity of more than 12 minutes of continuous handwriting. When the pen is once 
again within range of a printer, it transfers any buffered digital ink. 
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A pen can be registered with any number of printers, but because ail state data resides in 
Netpages both on paper and on the network, it is largely immaterial which printer a pen is 
communicating with at any particular time. 



When the Netpage Printer receives a digital ink stroke from the pen, it retrieves the page 
layout of the Netpage identified in the stroke, to allow it to correctly interpret the stroke. 
The printer resolves, via the DNS, the address of the Netpage Page Server which holds the 
page layout, and then retrieves the page layout from the server. If the page was recently 
identified in an earlier stroke, then the printer may already have the address of the relevant 
Netpage Page Server in its cache. It may also have the page layout itself in its cache, in 
which case there may be no need to retrieve it. 

Once the printer has the page layout of the Netpage to which the pen stroke refers, it can 
interpret the stroke in relation to the layout and content of the page. This involves hit-test- 
ing the objects on the page to determine which objects. the pen is interacting with, in much 
the same way that mouse movements and button presses are interpreted in a graphical user 
interface system. 

A "click" is a stroke where the distance between the pen down position and the subsequent 
pen up position is less than some small maximum. An object which is activated by a click 
requires a click to be activated, i.e. a longer stroke is ignored. The failure of a pen action, 
such as a "sloppy" click, to register is indicated by the lack of response from the pen's 
"ok" LED. 

There are two kinds of interactive objects on a Netpage: hyperlinks and form fields. 

When a hyperlink is activated, the printer sends a request to a handler somewhere on the 
network. The handler is identified by a URI, and the URI is resolved in the normal way via 
the DNS. There are three types of hyperlinks: general hyperlinks, form hyperlinks; and 
selection hyperlinks. A general hyperlink may implement a request for a linked document, 
or may simply signal a preference to a server. A form hyperlink submits the corresponding 
form to a form handler. A selection hyperlink submits the current selection to a selection 
handler. If the current selection contains a single-word piece of text, for example, the 
selection handler may return a single-page document giving the word's meaning within 
the context in which it appears, or a translation into a different language. Each hyperlink 
type is characterized by what information is submitted to the handler. 

Form fields come in four varieties: checkboxes, text areas,, digital ink areas, and signature 
areas. A checkbox accepts a true or false value. Any mark (a tick, a cross, a stroke, a fill 
zigzag, etc.) captured in a checkbox area is assigned as a true value to the corresponding 
field. A text area accepts a text string. Any digital ink captured in a text area is automati- 
cally converted to text via on-line handwriting recognition and the text is assigned to the 
corresponding field. A digital ink area accepts raw digital ink. Any digital ink captured in 
a digital ink area is assigned to the corresponding field. A signature area accepts a hand- 
written signature. Any digital ink captured in a signature area is automatically verified and 
the resulting signature token is assigned to the corresponding signature field. Signature 
verification is discussed in more detail in Section 8. 
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Table 2. Summary of pen interactions with a Netpage 



object 



hyperlink 



form field 



general 



form 



selection 



checkbox 



text area 



none 



digital ink area 



signature area 



click 



click 



click 



any mark 



handwriting 



digital ink 



signature 



circumscription 



^iactioh: 



submit action to handler via URI 



submit fomi to handler via URI 



submit selection to handler via URI 



set field value to true 



convert digital ink to text; 
assign text to field 



assign digital ink to field 



verify digital ink signature; 
assign signature token to field 



convert digital ink to region; 
select object(s) in region 



pen ™*,„gs,, L„ -oS'r::rc„;'^- ^-^^^^^^^ 

Wlhouc a wriler-dependenl gaining phase. "•^""^ m with h,gh accu- 

appended ,o,Err„i„:irr.^^;SSlar^'"'' " 
The printer maintains a current selection for earh rvn Th» 

recent object selected resolv^H v^rti, f ^^"^"^P^"- The selection contains the most 
tion can L JlcZTto^^^^^ '''' P'^^ '^^""^ ^"'^ The selec- 

tion handler i desc Ld Sfer The .1 / ^ '"f ''^ ^"""^'"^^ '° « ^^'e^- 
ensurepredicSbt behavtr ^"^^ cleared after an inactivity time-out to 

Table 2 provides a summary of pen interactions with a Netpage. 

5-7 Forms 
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A form can also act as a shared "blackboard" between the user and the form handler, i.e. 
the form handler can query the contents of the form fields maintained by the Netpage Page 
Server without the user explicitly submitting the form. 

For text areas, the raw digital ink is optionally also stored with the page instance on the 
Netpage Page Server. This allows the form handler to interrogate the raw digital ink 
should it suspect the original recognition of the handwriting. This might involve human 
intervention at the application level for forms which fail certain application-specific con- 
sistency checks. As an extension to this, the entire background area of a form can be des- 
ignated as a digital ink area. The form handler can then decide, on the basis of the 
presence of digital ink outside the explicit fields of the form, to route the form to a human 
operator, on the assumption that the user may have indicated amendments to the filled-in 
fields outside of those fields. 

Form fields can optionally be tagged to indicate their meaning. Fields tagged in this way 
may include name and address fields, for example. This semantic tagging allows these 
fields to be automatically filled in whenever a "blank" form is requested by an identifiable 
user, i.e. a user who has registered their identity with the system and linked it to the iden- 
tity of their pen. 

5.8 Standard Features of Netpages 

Each Netpage is printed with the Netpage logo at the bottom to indicate that it is a Netpage 
and therefore has interactive properties. The logo also acts as a "copy" button. In most 
cases pressing the logo produces a copy of the page. In the case of a form the button 
instead elicits a page giving the user the option to print the entire form document. And in 
the case of a secure document, such as a ticket or coupon, the button elicits an explanatory 
note or advertising page. 

The default single-page copy function is handled directly by the relevant Netpage Page 
Server. Special copy functions are handled by linking the logo button to other URIs. 

Once a Netpage fomi has been submitted, it is marked as submitted by the Netpage Page 
Server and cannot be submitted again. An attempt to do so elicits a status report indicating 
when it was submitted. A copy of the form can still be made, altered, and re-submitted. 

5.9 The Help System 

The Netpage Printer has a single button labelled "help". When pressed it elicits a single 
page of information. This information includes the following: 

• status of printer connection 

• status of printer consumables 

• top-level help menu 

• document function menu 

• top-level Netpage Network directory 

The help menu provides a hierarchical manual on how to use the Netpage System. 
The document function menu includes the following functions: 

• print a copy of a document 
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• print a clean copy of a form 

• print the status of a document 

of Jhe Smtr-i^; T"'f "7 P"""^'"^ """^-^ 'hen touching any page 

ei.vered, and to whom and when it was subsequently submitted as a form. 

a'^d%?r;;c1s^?trnV.:on "^^'^^^^ ^^'^--^y of publications 

"900" mrstr " n ^" alternative, the user can call the Netpage Network 

dL'L"rumen7 nTrS " ' "^^e ope.tor'caf loca";t 

publisher or thelerpa^The'lm^^^^^^^^^^^^ 

"''J'r'^ unavailable if the printer is unable to print. In this case the 
error l.ght .s l.t and the user can request remote diagnosis over the network 
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6 Personalized Publication 
Model 



In the following discussion, news is used as a canonical publication example to illustrate 
personalization mechanisms in the Netpage System. Although news is often used in the 
limited sense of newspaper and newsmagazine news, the intended scope is wider. 

In the Netpage System, the editorial content and the advertising content of a news publica- 
tion are personalized using different mechanisms. The editorial content is personalized 
according to the reader's explicitly stated and implicitly captured interest profile. The 
advertising content is personalized according to the reader's locality and demographic. 



A subscriber can draw on two kinds of news sources: those that deliver news publications, 
and those that deliver news streams. While news publications are aggregated and edited by 
the publisher, news streams are aggregated either by a news publisher or by a specialized 
news aggregator. News publications typically correspond to traditional newspapers and 
newsmagazines, while news streams can be many and varied: a "raw" news feed from a 
news service, a cartoon strip, a freelance writer's column, a friend's bulletin board, or the 
reader's own e-mail. 

The Netpage Publication Server supports the publication of edited news publications as 
well as the aggregation of multiple news streams. By handling the aggregation and hence 
the formatting of news streams selected directly by the reader, the server is able to place 
advertising on pages over which it otherwise has no editorial control. 

The subscriber builds a daily newspaper by selecting one or more contributing news pub- 
lications, and creating a personalized version of each. The resulting daily editions are 
printed and bound together into a single newspaper. The various members of a household 
typically express their different interests and tastes by selecting different daily publica- 
tions and then customizing them. 

For each publication, the reader.optionallyL selects specific-sections. Some sections appear 
daily, while others appear weekly. The daily sections available from The New York Times 
online, for example, include "Page One Plus", "National", "International". "Opinion", 
"Business", "Arts/Living", "Technology", and "Sports". The set of available sections is 
obviously specific to a publication, as is the default subset. 

The reader extends the daily newspaper by creating custom sections, each one drawing on 
any number of news streams. Custom sections might be created for e-mail and friends' 
announcements ("Personal"), or for monitoring news feeds for specific topics ("Alerts" or 
"Clippings"). 

For each section, the reader optionally specifies its size, either qualitatively (e.g. short, 
medium, or long), or numerically (i.e. as a limit on its number of pages), and the desired 
proportion of advertising, either qualitatively (e.g. high, normal, low, none), or numeri- 
cally (i.e. as a percentage). 

The reader also optionally expresses a preference for a large number of shorter articles or 
a small number of longer articles. Each article is ideally wrinen (or edited) in both short 
and long forms to support this preference. 



6.1 



Editorial Personalization 
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sophSion 7 r '^1'"^^ '° ""^'^h the expected 

ZtZ^a lZ J ''""J"' P™^'''" ^'^'"'^^"'^ ^"'l ^'l"'^' versions. The 

'TX al" r^'fr '° ^""^^^'^ "^^ ^^^der can specify a 

reading age which takes precedence over their biological age. 

The articles which make up each section are selected and prioritized by the editors and 

in priority order, subject to space constraints in the subscribers' editions. 

LV Th!!:"?«Th " 'r appropriate, the reader may optionally enable Collaborative filter- 
Mllut.V^^' f^'' '"""t', ^^'"'^ ^ sufficiently long lifetime. Each article 
Trticle Ve U filtering is printed with rating buUons at the end of the 

mnrJ iV? P^^^'^^ 3" ^^^y choice (e.g. "liked" and "disliked"), making it 

more likely that readers will bother to rate the article. ^ 

Articles with high priorities and short lifetimes are therefore effectively considered essen- 
tial reading by the editors and are delivered to most relevant subscribed. 

^u^Zf^' optionally specifies a serendipity factor, either qualitatively (e.g. do or don't 
surpnse me) or numerically A high serendipity factor lowers the threshold usedTor 
matching during collaborative filtering. A high factor makes it more likely that the coJe- 
sponding section will be filled to the reader's specified capacity. A diffeC ere„Z^ 
factor can be specified for different days of the week. serendipity 

mnH-T'*!!!^'"*'- ''P^^'fi" topics of particular interest within a section and this 

modifies the priorities assigned by the editors. 

or bith IfThe u °P''°"«"yf P^<='fi«^ ^ P'-^fe'-ence for fewer images or smalter images 

Ler Qulut^ ri T.M ' f r '"^y "e delivered at 

lower quality (i.e. at lower resolution or with greater compression). 

bcaS^VLTin !!°^ ^"'"' ''"^^ ^"^ values are 

and me fl^l °h'''? '^'"^ ^^^''^"^ ""'^^ ""P^"^' or metric, a local timezone 
and time format, and a local currency, and whether the localization consist of in situ trans- 
lation or annotation. These preferences are derived from the reader's locality by defauTt 

ZZ^ZlZltV'^'T'''"" eyesight, the reader optionally specifies a 

fnd f presentation. Both text and images are scaled accordingly 

and less information is accommodated on each page. "rumgiy, 

i7or!Vr'!^f"!! ' "IT Publication is published, and its corresponding text encod- 
hf M f Property of the publication and not a preference expressed by the user However 
the Netpage Network may provide automatic translation services in various guises 

6.2 ADVERTISING LOCALIZATION AND TARGETING 

The personalization of the editorial content directly affects the advertising content 
because advertising is typically placed to exploit the editorial context. Travel ads for 
example, are more likely to appear in a travel section than elsewhere. The value of the'edi- 

ZTl^ZT '7" T"'"'"': ^'"^ '° P"'"'^»'^^> its ability to attract 

large numbers of readers with the right demographics. 
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Effective advertising is placed on the basis of locality and demographics. Locality deter- 
mines proximity to particular services, retailers etc., and particular interests and concerns 
associated with the local community and environment. Demographics determine general 
interests and preoccupations as well as likely spending patterns. 

A news publisher's most profitable product is advertising "space", a multi-dimensional 
entity determined by the publication's geographic coverage, the size of its readership, its 
readership demographics, and the page area available for advertising. 

In the Netpage System, the Netpage Publication Server computes the approximate 
multi-dimensional size of a publication's saleable advertising space on a per-section basis, 
taking into account the publication's geographic coverage, the section's readership, the 
size of each reader's section edition, each reader's advertising proportion, and each 
reader's demographic. 

In comparison with other media, the Netpage System' allows the advertising space to be 
defined in greater detail, and allows smaller pieces of it to be sold separately. It therefore 
allows it to be sold at closer to its true value. 

For example, the same advertising "slot" can be sold in varying proportions to several 
advertisers, with individual readers' pages randomly receiving the advertisement of one 
advertiser or another, overall preserving the proportion of space sold to each advertiser. 

The Netpage System allows advertising to be linked directly to detailed product informa- 
tion and online purchasing. It therefore raises the intrinsic value of the advertising space. 

Because personalization and localization are handled automatically by Netpage Publica- 
tion Servers, an advertising aggregator can provide arbitrarily broad coverage of both 
geography and demographics. The subsequent disaggregation is efficient because it is 
automatic. This makes it more cost-effective for publishers to deal with advertising aggre- 
gators than to directly capture advertising. Even though the advertising aggregator is tak- 
ing a proportion of advertising revenue, publishers may find the change profit-neutral 
because of the greater efficiency of aggregation. The advertising aggregator acts as an 
intermediary between advertisers and publishers, and may place the same advertisement in 
multiple publications. 

It is worth noting that ad placement in a Netpage publication can be more complex than ad 
placement in the publication's traditional. counterpart,- because the publication's advertis- 
ing space is more complex. While ignoring the full complexities of negotiations between 
advertisers, advertising aggregators and publishers, it is clear that the Netpage System 
should ideally provide some automated support for these negotiations, including support 
for automated auctions of advertising space. Automation is particularly desirable for the 
placement of advertisements which generate small amounts of income, i.e. small or highly 
localized advertisements. 

Once placement has been negotiated, the aggregator captures and edits the advertisement 
and records it on a Netpage Ad Server. Correspondingly, the publisher records the ad 
placement on the relevant Netpage Publication Server. When the Netpage Publication 
Server lays out each user's personalized publication, it picks the relevant advertisements 
from the Netpage Ad Server. 
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6-3 User Profiles 

STnTJi^t" ''"'"'""■^"^ °" ^" of user-specific 

• publication custom izations 

• collaborative filtering vectors 

• contact details 

• presentation preferences 

tTl!n P"!"'^«"°" is typically publication-specific, and so the customiza- 

tion mfonnat.on is maintained by the relevant Netpage Publication Server. 

^ ,''h«^''°i!^h °^ "^^'•'^ '■^''"gs of « """iber of news items 

■ of It ^'"7 " "^'^ *° ^'"■^'•^"^ user^' interests for the pu^oTes 

rlZ ZZ^'^T 'T'- TT^"" "^"^"^^ '° maintaining a single' oHabS 

w?v it i mn^ 7 independently of any particular publication, there are ^o reasons 
why ,t ,s more practical to maintain a separate vector for each publication- there is likelv 

retweerrosrT'^'K'^r" ":f J"^°" of subscribers to tfe same publication tht 
between those of subscribers to different publications; and a publication is likely to want 

Le found e?' "r ^°"?r".^ ""'^""^ ^^'^'^^ ^ °f of its brand nr"o 
be found elsewhere. Collaborative filtering vectors are therefore also maintained bv the 
relevant Netpage Publication Server. mdiniainea oy the 

£s'eTc''a?J hlih''"'''"f ^^/ddress, ZIP Code, state, countiy, telephone num- 

bers, etc., are by their nature global and are maintained by a Netpage Registration Server. 

Presentation preferences including those for quantities, dates and times discussed in Sec- 
tion 6. 1 , are I ikewise global and maintained in the same way. 

The localization of advertising relies on the locality indicated in the user's contact details 
while the targeting of advertising relies on personal information such as date of birifgei 

aoe P^'^'^"' °^ ^"^"'^^i-- derivatives such" 

age range and income range. 

'^T '° I""™"' '"fo"""'"" for advertising purposes. Ihe 

.nfon„al,o„ ,s mamtamrf by the relevant Nelpage ReglsMion Server. In Ae isence „r 

.^:raa;rCg:cr„t~^^^^^^^^^^ 

fnv n."'^K ""^r authorized to use any number of printers, and each printer may allow 
nIn.T f r '° T ^""^^ "^"^ " ''"Sle default printer, to which periodical 

publications are delivered. The server keeps track of which publishers a user has autho- 
rized print to the user's default printer 

Each user may have several pens, but a pen is specific to a single user. If a user is autho- 
rized to use a particular printer, then that printer recognizes any of the user's pens. 

These relationships are illustrated in Figure 3. 
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Netpage 
pen 
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Figure 3. User registration relationships 

The pen identifier is used, in the form of a URN, to locate the corresponding user profile 
maintained by a particular Netpage Registration Server, via the DNS in the usual way. 

A Web terminal can be authorized to print on a particular Netpage Printer, allowing Web 
pages and Netpage documents encountered during browsing to be conveniently printed on 
the nearest Netpage Printer. 



6.4 Intelligent Page Layout 

The Netpage Publication Server automatically lays out the pages of each user's personal- 
ized publication on a section-by-section basis. Since most advertisements are in the form 
. of pre-formatted rectangles, they are placed on the page before the editorial content. 

The advertising ratio for a section can be achieved with wildly varying advertising ratios 
on individual pages within the section, and the ad layout algorithm exploits this. The algo- 
rithm attempts to co-locate closely tied editorial and advertising content, e.g. ads for roof- 
ing material placed specifically with the publication because of a special feature on 
do-it-yourself roofing repairs. 

The editorial content selected for the user, i.e. text with associated images and graphics, is 
then laid out according to various aesthetic rules. 

The entire process, including the selection of ads and the selection of editorial content, 
must be iterated once the layout has converged, to attempt to more closely achieve the 
user's stated section size preference. The section size preference can, however, be 
matched on average over time, allowing significant day-to-day variations. 



6.5 Document Format 

Once the document is laid out, it is encoded for efTicient distribution and persistent storage 
on the Netpage Network. 

The primary efficiency mechanism is the separation of information specific to a single 
user's edition and information shared between multiple users' editions. The specific infor- 
mation consists of the page layout. The shared information consists of the objects to which 
the page layout refers, including images, graphics, and pieces of text. 
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° M. r«T'"' ^"''y-^i"™^"^^ text represented in the Extensible Markup Lan- 
DrecIL cn . \^ ^ """^ ^"'""'""^ L^W^ <XSL) [69]. XSL pLides 

SnTs.? '^""""'"S independently of the region into which the text i 

embedded ^ ' h " "u'"^ text object conta n 

embedded language codes to enable automatic translation, and embedded hyphenaUon 
hmts to aid with paragraph formatting. " "ypnenation 

fomirSll" JPEG 2000 wavelet-based compressed image 

fonyat [34]. The original DCT-based JPEG algorithm introduces negligible visual loss at 
compression ratios below 10:1 [65]. JPEG 2000 is planned to achieve fhe same quaM^ a 
compression ratios 30% higher, i.e. at about 13:1 [35]. ^ ^ 

A graphic object encodes a 2D graphic in Scalable Vector Graphics (SVG) [71] format. 

^Vm^T '''t'f ^ ^ ^"^^ of placed image and graphic objects, linked textflow 

ttn 5 6 anT' '^yP^'-""'^^ ^"'^ '"P"t fi-'d-^ described in Sec 

tion 5.6, and watermark regions. These layout.objects are summarized in Table 3 The lay- 
out uses a compact fomat suitable for efficient distribution and storage. 

JUblSon ^ '^^^"'^ r"*" °f 'he text-setting algorithm used by the Netpage 

Publication Server when the layout was first created, allowing the NetpLe Printer to 
exactly reproduce the physical layout intended by the server. 

^feasibl^for M?"""' o ^"•^•"^''•^^"y "Pg^ded over the Netpage Network, it 

IS feasible for Netpage Printers to contain every version of the text-setting algorithm. 

Table 3. Netpage layout objects 



■.^:Sf Object 






image 


position 






image object URI 


JPEG 2000 


graphic 


position 






graphic object URI 


SVG 


textflow 


textflow id 






region^ 






optional text object URI 


XML/XSL 


hyperlink 


type 






region^ 






handler URI 




field 


type 






meaning 






region^ 




watermark 


region^ 





a. arbitrary multi-edged shape defined with spline paths 

6.6 Document Distribution 

As described above, for purposes of efficient distribution and persistent storage on the 
whScM^rSr • ' "^^^ ""^'^^^'^ shared Sjectst 
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When a subscribed publication is ready to be distributed, the Netpage Publication Server 
allocates, with the help of the Netpage Id Server, a globally unique id for each page, page 
instance, document, and document instance. 

The server computes a set of optimized subsets of the shared content and creates a muhi- 
cast channel for each subset, and then tags each user-specific layout with the names of the 
multicast channels which will carry the shared content used by that layout. The server then 
pointcasts each user's layouts to that user, and when the pointcasting is complete, multi- 
casts the shared content on the specified channels. After receiving its pointcast, each 
Netpage Printer subscribes to the multicast channels specified in the page layouts. During 
the multicasts, each printer extracts from the multicast streams those objects referenced by 
its page layouts. 

Once a printer has received all the objects to which its page, layouts refer, the printer 
re-creates the fully-populated layout and then rasterizes and prints it. 

The server also delivers each page layout to the relevant Netpage Page Server, which may 
be co-located with the Netpage Publication Server, or may be located elsewhere on the 
network. Thus the page layouts are persistently archived as Netpages. It is the responsibil- 
ity of the Netpage Publication Server to preserve the shared objects referenced by the 
Netpages, to ensure that they are really persistent. It may choose to archive these shared 
objects elsewhere on the network at any time. The object URIs embedded in the Netpages 
allow the objects to move. 

Under normal circumstances, the printer prints pages faster than they can be delivered. 
Assuming a quarter of each page is covered with images, the average page has a size of 
less than 400KB'. The printer can therefore hold in excess of 100 such pages in its internal 
64MB memory, allowing for temporary buffers etc. The printer prints at a rate of one page 
per second. This is equivalent to 400KB or about 3Mbit of page data per second, which is 
similar to the highest expected rate of page data delivery over a broadband network. 

Even under abnormal circumstances, such as when the printer runs out of paper, it is likely 
that the user will be able to replenish the paper supply before the printer's 100-page inter- 
nal storage capacity is exhausted. 

However, if the printer's internal memory does fill up,v.then the' printer will be unable to 
make use of a multicast when it first occurs. The Netpage Publication Server therefore 
allows printers to submit requests for re-multicasts. When a critical number of requests is 
received or a timeout occurs, the server re-multicasts the corresponding shared objects. 

Once a document is printed, a Netpage Printer can produce an exact duplicate at any time 
by retrieving its page layouts from the relevant Netpage Page Server and retrieving the 
objects to which they refer from the network. 



When a Netpage document is requested ad hoc, it is personalized and delivered in much 
the same way as a periodical. However, since there is no shared content, delivery is made 
directly to the requesting printer, i.e. without the use of multicast. 



I. 267 pixels per inch (ppi) 24-bit RGB, compressed using JPEG 2000 at a ratio of 1 3: 1 . 



6.7 



On-Demand Documents 
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When a non-Netpage document is requested ad hoc. it is not personalized, and it is deliv- 
ered via a designated Netpage Formatting Server which reformats it as a Netpaee docu 
ThT M . "T Server is a special instance of a Netpage PublicatL SeXer" 

Jnri ^.^•P^8%'^°™^«ing Server has knowledge of myriad IntemJt document fo™I!s 

nc udmg old favorites such as Adobe's Portable Document Format (PDF) W a^d HTper 
tex Markup Language (HTML) [70]. In the case of HTML, it makes use o^th^ higher reT 
olution of the printed page to present Web pages in a two-column format with a table of 

inked to tJ " Z^""'^^- ^^f-'t automatically includes all W b page dt t^ 
linked to the requested page. The user can tune this behavior via a preference. 

The Netpage Fomiatting Server makes standard Netpage behavior, including interactivity 
^^X^ P^Tsf^^^^^ '""""^ '"'^ '""^ Netpage Printer anrhe 
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7 Security 



7.1 



Cryptography 



Cryptography is used to protect sensitive information, both in storage and in transit, and to 
authenticate parties to a transaction. There are two classes of cryptography in widespread 
use: secret-key cryptography and public-key cryptography. The Netpage Network uses 
both classes of cryptography. 

Secret-key cryptography, also referred to as symmetric cryptography, uses the same key to 
encrypt and decrypt a message. Two parties wishing to exchange messages must first 
arrange to securely exchange the secret key. 

Public-key cryptography, also referred to as asymmetric cryptography, uses two encryp- 
tion keys. The two keys are mathematically related in such a way that any message 
encrypted using one key can only be decrypted using the other key. One of these keys is 
then published, while the other is kept private. The public key is used to encrypt any mes- 
sage intended for the holder of the private key. Once encrypted using the public key, a 
message can only be decrypted using the private key. Thus two parties can securely 
exchange messages without first having to exchange a secret key. To ensure that the pri- 
vate key is secure, it is normal for the holder of the private key to generate the key pair. 

Public-key cryptography can be used to create a digital signature. If the holder of the pri- 
vate key creates a known hash of a message and then encrypts the hash using the private 
key, then anyone can verify that the encrypted hash constitutes the "signature" of the 
holder of the private key with respect to that particular message, simply by decrypting the 
encrypted hash using the public key and verifying the hash against the message. If the sig- 
nature is appended to the message, then the recipient of the message can verify both that 
the message is genuine and that it has not been altered in transit. 

To make public-key cryptography work, there has to be a way to distribute public keys 
which prevents impersonation. This is normally done using certificates and certificate 
authorities. A certificate authority is a trusted third party which authenticates the connec- 
tion between a public key and someone's identity. The certificate, authority verifies the 
person's identity by examining identity documents etc., and then creates and signs a digi- 
tal certificate containing the person's identity details and public key. Anyone who trusts 
the certificate authority can use the public key in the certificate with a high degree of cer- 
tainty that it is genuine. They just have to verify that the certificate has indeed been signed 
by the certificate authority, whose public key is well-known. 

In most transaction environments, public-key cryptography is only used to create digital 
signatures and to securely exchange secret session keys. Secret-key cryptography is used 
for all other purposes. 

In the following discussion, when reference is made to the secure transmission of informa- 
tion between a Netpage Printer and a server, what actually happens is that the printer 
obtains the server's certificate, authenticates it with reference to the certificate authority, 
uses the public key-exchange key in the certificate to exchange a secret session key with 
the server, and then uses the secret session key to encrypt the message data. A session key, 
by definition, can have an arbitrarily short lifetime. 
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7.2 Netpage Printer Security 

Each Netpage Printer is assigned a pair of unique identifiers at time of manufacture which 
are stored in read-only memory in the printer and in the Netpage Registration Server data- 
base. The first Id IS public and uniquely identifies the printer on the Netpage Network. The 
second Id is secret and is used when the printer is first registered on the network. 

When the printer connects to the Netpage Network for the first time after installation it 
creates a signature public/private key pair. It transmits the secret id and the public key 
securely to the Netpage Registration Server. The server compares the secret id against the 
printer s secret id recorded in its database, and accepts the registration if the ids match It 
then creates and signs a certificate containing the printer's public id and public signature 
key, and stores the certificate in the registration database. 

The Netpage Registration Server acts as a certificate authority for Netpage Printers, since 
It has access to secret information allowing it to verily printer identity. 

When a user subscribes to a publication, a record is created in the Netpage Registration 
Server database authorizing the publisher to print the publication to the user's default 
printer. Every document sent to a printer is addressed to a particular user and is signed by 
the publisher using the publisher's private signature key. The printer verifies, via the regis- 
tration database, that the publisher is authorized to print the publication on the specified 
user s default printer and that the printer is the user's default printer The printer verifies 
the signature using the publisher's public key, obtained from the publisher's certificate 
stored in the registration database. 

The Netpage Registration Server accepts requests to add printing authorizations to the 
database, so long as those requests are initiated via a pen registered to the printer. 

The user can authorize a Web terminal to print on a printer. This is useful if the user has a 
Web terminal m the home which is used to locate documents on the Web for printing The 
one-time authorization proceeds as follows: the user prints a Web terminal authorization 
torm. The Netpage Registration Server generates a short-lifetime one-time-use id for the 
Web terminal which is printed on the form, together with the URI of the printer The Web 
terminal is used to navigate to a Netpage Registration Server registration site, where the 
one-time-use id is entered, as well as the URI of the printer. The Web terminal generates a 
signature public/private key pair. The server allocates a terminal id for the Web terminal, 
creates and signs a certificate containing the terminal id and the public key and stores the 
certificate in the registration database. The URI of the printer, the Web temiinal's terminal 
Id, and the private signature key are stored locally on the Web terminal. 

Whenever the Web terminal wishes to print on the printer, it sends the printer's designated 
Netpage Formatting Server a request containing the URI of the document to be printed, 
together with the terminal id, signed with the Web terminal's private signature key On 
receipt of the request and before acting on it, the server verifies, via the registration server, 
that the terminal is authorized to print on the specified printer, and verifies the signature 
using the terminal's public key, obtained from the terminal's certificate stored in the regis- 
tration database. 

The user can print a list of current printing authorizations at any time, and revoke any 
which are being abused. 
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7.3 



Netpage Pen Security 



Each Netpage Pen is assigned a unique identifier at time of manufacture which is stored in 
read-only memory in the pen and in the Netpage Registration Server database. The id 
uniquely identifies the pen on the Netpage Network. 

A Netpage Pen can know a number of Netpage Printers, and a printer can know a number 
of pens. A pen communicates with a printer via a radio frequency signal whenever it is 
within range of the printer. Once a pen and printer are registered, they regularly exchange 
session keys. Whenever the pen transmits digital ink to the printer, the digital ink is always 
encrypted using the appropriate session key. Digital ink is never transmitted in the clear. 

A pen stores a session key for every printer is knows, indexed by printer id, and a printer 
stores a session key for every pen it knows, indexed by pen id. Both have a large but finite 
storage capacity for session keys, and will forget a session key on a least-recently-used 
basis if necessary. 

When a pen comes within range of a printer, the pen and printer discover whether they 
know each other If they don't know each other, then the printer determines whether it is 
supposed to know the pen, i.e. because the pen belongs to a user who is registered to use 
the printer. If the printer is meant to know the pen but doesn't, then it initiates the auto- 
matic pen registration procedure. If the printer isn't meant to know the pen, then it agrees 
with the pen to ignore it until the pen is placed in a charging cup, at which time it initiates 
the registration procedure. 

In addition to its public id, the pen contains a secret id and a secret key-exchange key, both 
intended for one-time use. These are also recorded in the Netpage Registration Server 
database at time of manufacture. During registration, the printer obtains the secret id from 
the pen. Because it is transmitted in the clear, it may be intercepted by someone listening 
in. The printer transmits the id securely to the Netpage Registration Server, which 
responds securely with the matching key-exchange key, together with a newly-generated 
secret id and key-exchange key. The printer generates a session key for the pen and trans- 
mits it to the pen encrypted using the one-time-use key-exchange key. It also securely 
transmits the new secret id and key-exchange key to the pen, which saves them for the 
next registration procedure. They now match the pen's record in the Netpage Registration 
Server database. 

If the secret id transmitted in the clear, from the pen to the printer is intercepted and used to 
retrieve the secret key-exchange key from the Netpage Registration Server before the 
printer queries the server, then the server rejects the printer's query because the secret id is 
out-of-date. Thus the printer knows that the pen has been compromised, and recommends 
that it be returned for repair. 

When a previously unregistered pen is first registered, it is of limited use until it is linked 
to a user A registered but "un-owned" pen is only allowed to be used to request and fill in 
Netpage user and pen registration forms [3], i.e. to register a new user to which the new 
pen is automatically linked, or to add a new pen to an existing user 

The pen uses secret-key rather than public-key encryption because of hardware perfor- 
mance constraints in the pen. 
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7.4 Secure Documents 



Ln« T^ff ^"PP*""' Of secure documents such as tickets and cou- 

reaueJfr ^^'P^f P""^^"; « *"«<=i'ity to print watermarks, but will only do so on 

to TrS ' I"'''' '"'■'''"y '^^ P^'^'^her indicates its authorit^ 

to print watermarks .n its certificate, which the printer is able to authenticate. 

The "watermark'' printing process uses an alternative dither matrix in specified "water 
ma k regions of the page. Back-to-back pages contain mirror-image waterm rk region; 
wh ch comc.de when pnnted. The dither matrices used in odd and even pages' wateS 
regions are designed to produce an interference effect when the regions are vTweS 
together - i.e. when looking through the printed sheet. 

The effect is similar to a watermark in that it is not visible when looking at only one side 
ofthe page, and IS lost when the page is copied by nomial means. yones.de 

As described in Section 5.8, pages of secure documents cannot be copied using the built-in 
Netpage copy mechanism. This extends to copying Netpages on Netpage-atare photo- 



Secure documents are typically generated as part of e-commerce transactions Thev can 
Ujerefore include the user's photograph which was captured when the user registered bic^ 
metric information with the Netpage Registration Server, as described in Section 8. 

bJ'renZir'^f "^''^ " '^T^ document, the recipient can verify its authenticity 

forth! . f r ^ ' rTV" ^"y- "^'^ ""''l"^ °f ^ ^""^^ document is only valS 

trortent '"T"'' '^'"^^ ''"^""^"^ non-contiguously 

can be H 7 P'f^'^^'"" by opportunistic foi^ers. A secure document verificatln pe^ 

no^r f ^^"^^"'^ °" verification failure, to support easy 

point-of-presentation document verification. ^ 

?1Z^^tII^''^^' watennark nor the user's photograph are secure in a ciyptographic 
fic/t?.„ ^ P™^"*^ ^ significant obstacle to casual forgeo'. Online document veri- 

icat.on, part.cularly using a verification pen. provides an added level of security where it 
IS needed, but .s still not entirely immune to foi^eries. 



7.5 Non-Repuoiation 



In the Netpage System, forms submitted by users are delivered reliably to forms handlers 
^eTurel::;^" °" "^'"^^^ '^---^ '--'^'^ recip^ 

fmToTs;rL7e;:;:e:ot^^^^^^^^^ ^^^'^^^ ^-^^'^^^ - - 
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8 Electronic Commerce Model 



The Netpage System uses the Secure Electronic Transaction (SET) [43] system as its pay- 
ment system model. Although SET is not yet widely supported, it is comprehensive and 
elegant and will probably become dominant in the near future. 

SET having been developed by MasterCard and Visa, is organized around payment cards, 
and this is reflected in the terminology. However, much of the system is independent of 
the type of accounts being used. 

In SET, cardholders and merchants register with a certificate authority and are issued with 
certificates containing their public signature keys. The certificate authority verifies a card- 
holder's registration details with the card issuer as appropriate, and verifies a merchant's 
registration details with the acquirer as appropriate. Cardholders and merchants store their 
respective private signature keys securely on their computers. During the payment pro- 
cess, these certificates are used to mutually authenticate a merchant and cardholder, and to 
authenticate them both to the payment gateway. 

SET has not yet been adopted widely, partly because cardholder maintenance of keys and 
certificates is considered burdensome. Interim solutions which maintain cardholder keys 
and certificates on a server and give the cardholder access via a password have met with 
some success [14]. 



In the Netpage System the Netpage Registration Server acts as a proxy for the Netpage 
user (i.e. the cardholder) in SET payment transactions. 

The Netpage System uses biometrics to authenticate the user and authorize SET payments. 
Because the system is pen-based, the biometric used is the user's on-line signature, con- 
sisting of time-varying pen position, tilt and pressure. A fingerprint biometric can also be 
used by designing a fingerprint sensor into the pen, although at a higher cost. The type of 
biometric used only affects the capture of the biometric,^ not the authorization aspects of 
the system. 

The first step to being able to make SET payments is to register the user's biometric with 
the Netpage Registration Server. This is done in a controlled environment, for example a 
bank, where the biometric can be captured at the same time as the user's identity is veri- 
fied. The biometric is captured and stored in the registration database, linked to the user's 
record and to the record of a particular Netpage Pen. The user's photograph is also option- 
ally captured and linked to the record. The SET cardholder registration process is com- 
pleted, and the resulting private signature key and certificate are stored in the database. 
The user's payment card information is also stored, giving the Netpage Registration 
Server enough information to act as the user's proxy in any SET payment transaction. 

When the user eventually supplies the biometric to complete a payment, for example by 
signing a Netpage order form, the printer securely transmits the order information, the pen 
id and the biometric data to the Netpage Registration Server. The server verifies the bio- 
metric with respect to the user identified by the pen id, and from then on acts as the user's 
proxy in completing the SET payment transaction. 



8.1 



Secure Electronic Transaction (SET) 



8.2 



SET Payments 
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8-3 Micro-Payments 

The Netpage Network includes a mechanism for micro-payments, to allow the user to be 
conveniently charged for printing low-cost documents on demand and for copying copy- 
right documents, and possibly also to allow the user to be reimbursed for expenses 
mcurred m printing advertising material. The latter depends on the level of subsidy 
already provided to the user. 

When the user registers for e-commerce, a network account is established which aggre- 
gates micro-payments. The user receives a statement on a regular basis, and can settle any 
outstandmg debit balance using the standard payment mechanism. 

The network account can be extended to aggregate subscription fees for periodicals, which 
would also otherwise be presented to the user in the form of individual statements. 

8.4 Transactions 

Whenever a transaction originates through a Netpage form, the form handler has sufficient 
mformation, in the shape of the form's unique document instance id, to maintain transac- 
tion-specific state information. However, a transaction may also originate through a 
non-form page such as a printed catalog page, implying, for example, the existence of a 
virtual "shopping cart". In this case the relevant transaction state information is tied, indi- 
rectly, to the unique id of the user. 

The Netpage Registration Server maintains an anonymous relationship between a user and 
a transaction handler via a uniquely numbered transaction, as illustrated in Figure 4. 
Whenever the user activates a hyperlink tagged with the "transaction" attribute, the 
Netpage Printer asks the Netpage Registration Server to translate the associated handler 
id, together with the pen id, into a transaction id. The transaction id is then submitted to 
the hyperlink transaction handler. For efficiency, the printer caches transaction ids. 

The transaction handler maintains state information indexed by transaction id. It is able to 
retrieve user-specific state information without explicit knowledge of the user. 



transaction 



transaction 
handler 



Figure 4. User transaction 
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Applications and 
Business Models 
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9 Applications 

tTaSiHn'^f^^^r'''*' ^h^. potential to subsume a wide variety of applications in both 
traditional and electronic media. This section sketches the following possibilities: 

• personalized subscriptions to newspapers, magazines and comics 

• subscriptions to freelance columns and bulletin boards 

• on-demand newspapers, magazines and comics 

• on-demand flyers and product brochures 

• on-demand books 

• television infotainment printing 

• e-commerce purchasing from online and traditional catalogs 

• delivery of statement and invoices, with online payment 

• delivery of secure document (tickets, coupons and licenses) 

• perfect copying with copyright micro-payments 

• mail replacement 

• delivery of greeting cards 

• form printing, fill-in, and submission 

• delivery of e-mail and facsimile 

• active business cards 

• on-demand document delivery on corporate intranets 

• provision of government services 

• Web browsing, searching and printing 

• photo album creation 

• persistent searchable note taking 

• exam taking and homework 

• computer printing 

Many of these applications are described in detail in [3]. 

9.1 Personalized Subscriptions 

The strength of the Netpage Network lies in automatically delivering subscribed periodi- 
cals, at a print quality equalling or exceeding that of their traditional counterparts with 
^fllTlo ' h"'"!!' ^o '•"t^'-ests, advertising content localized and tar- 

geted to individual localities and demographics, and advertising directly linked to detailed 
product information and product purchasing. ^ / 

9.1 .1 Newspapers and Magazines 

The Netpage Network offers a new delivery mechanism to the $24 billion newspaper and 
newsmagazine market which is both more cost-efFective than centralized printing and dis- 
tribution, and allows more fine-grained targeting of advertising. 

The simplest forrn of news personalization involves selecting a news publication and 
choosing which daily and weekly sections to receive. The simplest form of advertising 
personalization is tuned to the demographics associated with the subscriber's ZIP or 
2IP+4 code. Even with these entry-level forms of personalization, the Netpage Network 
oflTers a compelling distribution model for news. 



Confidential 



20 October 1999 



41 



Sitverbrook Research 



Netpage System Overview 



draft vO.4 



Users receive paper publications with the usability of their traditional counterparts, but 
with interactive properties. At the press of an on-page button, a user can print an article 
giving the background to a news story, print a personalized product brochure, or add a 
product to the virtual shopping basket. 

Any magazine normally printed on lightweight paper stock is equally well-suited to distri- 
bution on the Netpage Network. However, since Netpage Printers don't carry heavier 
paper stocks and don't provide wrap-around binding, the Netpage Network is less 
well-suited to the distribution of so-called '*glossy" magazines. 

9.1.2 Freelance Columns and Bulletin Boards 

Users can choose to subscribe to individual freelance columns, cartoons, etc. These can be 
integrated into a user's daily news document, or printed individually. Freelancers can 
choose to receive micro-payments from their subscribers, freeing them from maintaining 
their own subscriber databases. The Netpage Network provides-mechanisms for handling 
micro-payments. 

Users can also subscribe to the "bulletin boards" of friends: collections of news, 
announcements, pictures etc., which work much like freelance columns. 

9.2 On-demand Publications 

The Netpage Network can deliver, on demand, current and back issues of periodicals nor- 
mally delivered on subscription, including newspapers, magazines, and comics. To main- 
tain the interactivity of all Netpages ever printed, the Netpage Network keeps all 
published content online at all times. Unlike the Web, where hyperlinks become unreliable 
over time, content on the Netpage Network never expires. 

9.2.1 Flyers and Product Brochures 

The Netpage Network makes high-quality flyers and product brochures instantly avail- 
able, linked to advertisements and entries in printed catalogs. 

Brochures are always up-to-date, and link to e-commerce, e-mail, and automatic telephone 
call-back. Brochure links can provide "click-through" fees to linking documents, and sub- 
sidized printing to users. 

Active Netpage advertisements can appear in printed paper publications sold or delivered 
through traditional outlets, including newspapers and magazines sold on news stands, 
posters appearing in public places (including in buses, trains and taxis), and books sold in 
bookshops. Buying guides and travel guide books are particularly suited to containing 
active Netpage advertising. 

9.2.2 Books 

Users can obtain the latest best-sellers or rare "out-of-print" (a soon-to-obsoleted term) 
editions on demand, printed in column format with a text size chosen by the user. A typi- 
cal 300-page paperback fits on as little as 40 sheets of Letter paper. Slip-on covers are 
available for robust handling. 

Titles which have outlived their copyright period are available for free. Other titles are 
heavily discounted for Netpage delivery, since publishers avoid the costs of printing, 
inventory storage, and delivery. 
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Colorful children's books reproduce immaculately. When they've been loved to death, 
they can be printed again, and again. 

Children's coloring-in books and puzzles are available just when they're needed on a rainy 
day. 



9.2.3 Television Infotainment 

Users watching infotainment programs on television can print the associated informa- 
tional material on their Netpage Printer by pressing the "print" button on their remote con- 
trol at the appropriate time. The material may be a report on a new medical procedure, the 
plans for a do-it-yourself bookshelf, or a list of top investment opportunities. It may also 
be a subscription form for the print publication the program is promoting. 

The television and/or remote control is suitably modified or augmented to route the print 
request to the Netpage Printer. The television or remote control may, for example, include 
a radio transmitter or transceiver which allows it to communicate with the Netpage 
Printer. When the print button is pressed, a message is sent to the Netpage Printer which 
contains the identity of the television channel. The television channel id, date and time 
together uniquely identify the Netpage document associated with the program at that time. 
The printer constructs a URN based on the television channel id and determines the 
address of the television channel's document server via the DNS in the usual way. It then 
retrieves the document from the document server based on date and time. 

A potentially more flexible approach embeds the URN of the document in the television 
signal itself, for example as a closed caption. In analog television signals there is plenty of 
room for information in the vertical blanking interval (VBI). The advantage of leveraging 
support for closed captioning, in particular, is twofold. Closed caption decoders are now 
standard components in normal-sized television sets, and closed captioning is fully sup- 
ported in digital television standards that are now being deployed. Other VBI-based 
schemes require custom decoders and may not survive the transition to digital televisic 



sion. 



9.3 E-COMMERCE 

9.3.1 Online Purchases 

The Netpage Network supports a similar level of online purchasing as the Web, but in 
paper-based medium which presents like a high-quality printed catalog. 

A user can navigate the retailer's online Netpage catalog, printing catalog pages as they're 
needed and adding items to a virtual shopping trolley. The contents of the shopping cart 
can be listed at any time, and items can be struck from the list at the stroke of the pen. 
Pressing a "proceed to checkout" button at any time elicits a completed order form just 
waiting for the user's signature. The payment card account number is securely shown in 
the usual 1234 56** *♦*♦ ^789 format. The user's signature authorizes the payment. 



9.3.2 Catalog Purchases 



Rather than buying from an online Netpage catalog, the user can select items from a tradi- 
tionally-printed catalog which contains active Netpage links. 
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9.3.3 Statements and Invoices 

Statements and invoices can be securely and auditably delivered, and can be automatically 
filled in with the user's default payment details without the sender knowing those details. 

The user's signature can authorize the payment as normal. 

9.3.4 Secure Documents 

Retailers can securely issue tickets and coupons over the Netpage Network, printed with 
difficult-to- forge watermarks. 

Agencies of various kinds can issue licenses printed with watermarks and the user's own 
photograph. 

As described earlier, recipients can verify the authenticity of secure documents using a 
standard Netpage Printer or a special verification pen. 

9.3.5 Copyright Copying 

Any printed version of a Netpage document becomes an easy means to printing another 
perfect copy. When a copy is made, the Netpage Network can automatically transfer a 
micro-payment fi-om the copier to the copyright holder 

Trivial copyright fees are universally respected but seldom paid because of the inconve- 
nience. The Netpage Network offers micro-payment convenience and the quality of an 
original copy, 

9.3.6 Authenticated Signing and Exchange of Legal Documents 

Netpage supports authenticated delivery and printing of documents, and automatically 
captures and verifies signatures entered in signature fields. It can therefore support authen- 
ticated delivery and signing of legal documents. 

9.3.7 Retail Signature Capture 

Point-of-purchase signature capture is a common requirement when the customer uses a 
payment card or charge card. Some retailers are now adopting digitizing tablets with 
LCDs to capture signatures, both to reduce paperwork and potentially to implement signa- 
ture verification in the future. A Netpage paper roll which is printed with the details of 
each transaction and then captures the customer's signature provides an alternative. The 
customer benefits from the ease of using an ink pen on paper, while the retailer benefits 
from online signature capture and verification. 

9.4 Communication 

9.4.1 Mail 

The Netpage Network, once widely subscribed, can be used to deliver numerous instances 
of regular mail-outs, particularly statements and invoices as discussed in Section 9.3.3. As 
already described, the Netpage System only delivers mail from sources authorized by the 
recipient. 

The United States Postal Service delivers 107,000,000.000 pieces of First Class mail each 
year [65], a large number of which are regular in nature. 
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9.4.2 Greeting Cards 

A user can select a greeting card from an online catalog, add a handwritten message, and 
dispatch It via the Netpage Network. Cards can be addressed to other Netpage users, and 
to norma! postal addresses. In the latter case the card is printed at the service center closest 
to the recipient, automatically placed in an envelope, and mailed through the local mail 
system. 

Netpage users can choose to receive cards from anyone, or only from authorized friends. 

9.4.3 Forms 

Forms of all kinds can be printed on the Netpage Printer, filled in by hand, and submitted 
directly over the Netpage Network. Submission is secure and cannot be repudiated. 

Handwriting is automatically recognized by the system. The digital ink of the handwriting 
is attached to the form in case a human clerk needs to re-interpret the handwriting. Auto- 
matic ''handwriting bots" on the network can assist with the recognition task, automati- 
cally giving the user semi-intelligent feedback to elicit disambiguation. 

Any interactive Netpage "application", including e-commerce and e-mail, uses forms of 
various kinds. 



9.4.4 E-Mail 



E-mail forms can be printed on demand and filled in by hand. The handwritten name of 
the recipient is converted to facilitate delivery, but the rest of the message is delivered as 
digital ink, just as the user intended. If the recipient is computer-based rather than 
Netpage-based, all of the handwriting can be automatically converted, with the digital ink 
sent as an attachment (since it may contain hand-drawn diagrams etc). 

Netpage users can choose to receive e-mail from anyone, or only from authorized friends. 

Each user maintains a list of contacts which allows e-mail to be addressed by name. Users 
never deal with Netpage user ids directly. If the specified name is ambiguous, the system 
prints a list of choices. The use of nicknames helps to avoid ambiguity. 



9.4.5 Business Cards 



Each user's business card can act as a convenient one-time e-mail authorization token. It is 
encoded as a Netpage and contains a button which, when pressed by the card recipient, 
adds the card owner to the recipient's contact list and authorizes the recipient to send the 
card owner e-mail. 

The business card can also contain buttons which link to company information, personal 
information, and even product information if the user is a salesperson. 

The Netpage Network provides a bureau service which allows users to order active 

Netnapp KiiQinr>CG farHe 



Netpage business cards 
9.4.6 Facsimile 



Facsimile forms can be printed on demand and filled in by hand. The handwritten tele- 
phone number is converted to facilitate delivery, but the rest of the message is delivered as 
bitmapped digital ink, just as the user intended. 
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9.4.7 



Conferencing 



Geographically distributed participants can communicate graphical ideas via a shareid 
Netpage "whiteboard" while engaged in a telephone conference. Every time a participant 
adds a modification or a new diagram to the whiteboard the other participants are given a 
new copy of the page. New pages can be started at any time, but older pages or older ver- 
sions of pages can still be marked up and re-distributed. Each participant ends up with a 
full history of the interaction. Multiple colors and line styles can be chosen from a palette. 

Each printed page is timestamped and marked with the name of the author of the latest 
change. The latest change can be shown in a different style to the older content, to indicate 
what is new. For example, if the whiteboard is monochrome, then the latest change can be 
shown in color, or if the whiteboard is in color, then the latest change can be shown in bold 
strokes. 



Geographically distributed participants can mark up a shared Netpage document while 
engaged in a telephone conference. Every time a participant adds a modification or a new 
diagram to the document the other participants can be given a new copy of the page. A 
participant chooses to share their contribution with the other participants by pressing the 
<update> button which appears on every page. Older versions of pages can be marked up 
and re-distributed at any time. Each participant ends up with a full history of the interac- 
tion. Each participant's contribution can be shown in a different color, so that contribu- 
tions can be distinguished. A key printed on each page or an initial status page indicates 
which color corresponds to which participant. 

Each printed page is timestamped and marked with the name of the author of the latest 
change. Beyond color-coding each user's contribution, the latest change can be shown in a 
different style to older markup, to indicate what is new. For example, the latest change can 
be shown in bold strokes. 

A session chairperson creates the markup session and links a Netpage document to it. The 
chairperson then e-mails session invitations to potential participants. Each invitation con- 
tains an <accept> button, which, when pressed, adds the invitee to the session. The invita- 
tion also typically contains the date and time that the session is intended to start, presented 
in the local time of the invitee, as well as the name of the document and the purpose of the 
markup. The chairperson receives e-mail every. time an invitee accepts the invitation. The 
chairperson can distribute a markup, session control page to -the participants at any time, 
either before or during the actual session. The control page contains the session details, 
lists the session participants and shows their assigned markup colors, and contains a link 
to the document being marked up whereby the participant can obtain a copy. It also con- 
tains an <update> button which is used by the participant during the session to distribute 
their contribution to the other participants. 

The chairp>erson's session control page also contains <start session> and <end session> 
buttons. No markup is possible before the session is started or after the session is ended. 

The chairperson can designate non-contributory participants - i.e. ones who can monitor 
the markup session but cannot mark up the document themselves. 

The session invitatation also contains details on how to establish the telephone conference 
which accompanies the session. Where possible, the Netpage System controls the tele- 
phone system to initiate the conference. 



9.4.8 



Collaborative Document Markup 
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A non-Netpage document can be marked up by first turning it into a Netpage document 
I.e. by printing it to a Netpage Printer in Netpage mode (as described in Section 9.6.5). 



9,4.9 Postage Stamps 



Postage stamps can now be purchased over the Internet and printed on an inkjet printer. 
Netpage provides an even more compelling purchase and delivery mechanism for postage 
stamps because of its seamless payment mechanisms (for explicit payments and implicit 
micro-payments) and its support for secure documents. 

As Netpages, Netpage-delivered postage stamps can contain both attractive graphics and 
m visible machine-readable information such as source and destination codes, allowing 
mail systems to track mail items and automatically route them. 



9.4.10 Voicemail 



The Netpage System can provide access to nominated voicemail mailboxes maintained by 
a telephone system. The help page can contain a <voicemail> button which prints a list of 
voicemail messages received by the user of the pen. Each message shows the date and 
time of receipt, the name of the caller (determined by looking up an address book using 
the phone number provided by caller ID), and the status of the message - i.e. whether it has 
been played back yet. The user can oi:ganize the message list into a hierarchy of folders as 
described in Section 6 in [3], A message can be printed, in which case the system attempts 
to convert the message speech into text. The message can be played back through an 
optional speaker in the Netpage Printer. The message can also be played back through the 
user's mobile phone, either by the Netpage Printer controlling the mobile phone via its 
short-range radio interface (i.e. Bluetooth), or by the Netpage Printer instructing the tele- 
phone system to call the mobile phone and automatically play back the specified message. 



9.4.11 Interactive Plans 



Interactive plans can be printed as Netpages. The plans can be linked to a database and can 
be marked up with a Netpage Pen. -Multiple people can collaborate on a single paper plan, 
and small changes can be made to a plan on the shop floor, without requiring access to a 
computer or an operator with computer skills. 

If the plan is of a three-dimensional object, then different views of the object can be 
selected using a 3D view control, as described in Section 9 in [3]. 

The plan might be for a shoe design, and might show a dimensioned view of the shoe as 
well as a perspective view from a selected position. New dimensions can be entered in 
numeric fields and saved to the same plan file or to a new plan file. 



9.5 Corporate and Government 



9.5.1 Corporate Intranets 



An organization can use a private intranet-based Netpage Network to implement a docu- 
ment repository and efficiently distribute documents on demand. 
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9.5.2 Government Services 

Government can provide access to services via the Netpage Network. The network can 
obviate the need to visit government offices to obtain forms and submit forms, and the net- 
work can be used to efficiently deliver the results of submissions. 



9,6 Personal 



9.6.1 Web Browsing, Searching and Printing 

Users can browse the World Wide Web via their Netpage Printer using paper and pen as 
the user interface. Netpage forms can provide emulation of HTML forms. Only dynamic 
media objects may fail to print meaningfully. 

A Netpage Printer can be the ideal output device for documents encountered while brows- 
ing the Web, whether the browsing is terminal-based or.Netpage-based. An increasing 
number of print-ready documents are being published on the Web. 

Entire Web sites can be compactly formatted for print, since a printed page has a much 
greater information-bearing capacity than a computer screen, and perused in a more lei- 
surely fashion. The Netpage Formatting Server automatically adds a table of contents and 
an index of referenced pages. 

Links on Web pages remain active when printed on Netpages. Clicking on a link causes 
the linked Web page to be printed. 

Web pages and search results are printed on both sides of the paper, allowing one sheet of 
paper to hold the equivalent of ten SVGA screens of information. Thus the user sees 200 
links on paper, compared with only 20 on a computer screen. 



9.6.2 Photo Album 

A Netpage Printer can be enhanced with an infrared data connection (IrDA) to allow it to 
accept images wirelessly from a digital camera. Alternatively, digital cameras with USB 
ports can be directly connected. Images can be automatically archived on the Netpage 
Network, and individual photos, both regular and poster-sized,: can be printed at photo 
quality on the printer. 

Smart layout software can assist with the interactive creation of photo album pages, ready 
for insertion in a cumulative family album. 



9.6.3 Notebook 

A pre-printed Netpage notebook can be used to capture handwritten notes in a persistent 
fashion. Notes are captured on the network and are optionally timestamped and signed by 
a certificate authority to provide undeniable proof of priority, for example with respect to a 
patent application. Since the handwriting is recognized and converted to text for indexing 
purposes, the notes can also be searched by keyword, date, etc. 

9.6.4 Examination Papers and Homework 

Students can sit exams in a controlled manner while physically distant from the classroom. 
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An examination paper can be delivered at a specific time to a distributed collection of stu- 
dents. The students can then be required to answer the questions on the paper within the 
allotted time. Their answers can be automatically captured at the end of the allotted time 
using the "blackboard" form model, and in many cases automatically graded. Once again 
unrecognized input can be routed to a human operator. 

Multiple choice questions can be automatically graded. 

Homework in general can be distributed and captured in a similar way. 

9.6.5 Computer Printing 

A Netpage Printer can be the ideal output device for a personal computer or workstation 
whether directly-connected or on a local-area network. The speed of the Netpage Printer 
and the quality of its output make it attractive to existing computer users. 

The Netpage Printers have a USB port as a standard feature. 

A Netpage Printer can be used to print output from a computer system both as normal 
pages and as Netpages. When printed as Netpages, the pages are implicitly stored persis- 
tently on the Netpage Network, and the printed Netpages therefore have much of the inter- 
activity of Netpages which originate on the network. 

9.6.6 Netpage Photocopying 

A Netpage-aware photocopier can be used to turn normal pages into Netpages in a similar 
way. When a normal (non-Netpage) page is copied, a digital version of the page is stored 
persistently on a Netpage Page Server, and the page copied is printed as a Netpage which 
IS linked in the usual way to its digital counterpart. The digital version of the page may 
consist purely of an image of the page, or it may include text obtained via optical character 
recognition, thus allowing text-based searching. 

When a Netpage is copied, a perfect digital copy is produced, subject to the usual Netpage 
security considerations as discussed in Section 7.4. 

9.6.7 Games of Chance 

Many gambling games can be delivered through Netpage. -With instant lotto, just print the 
form, mark the appropriate numbers, and press the submit button. Win or lose, the 
Netpage response is instant. 

With a group lottery or Keno, again just print the form, mark the appropriate numbers, and 
press the submit button. Wait for the announcement of the winning numbers, for example 
on television. Winners are also notified by Netpage. 

9.6.8 Multi-Player Gaming 

Multi-player games can be standard games such as chess. The players take turns marking 
moves on a Netpage showing the status of the game. After each move the player presses 
the submit button. The update is automatically printed on the other player^s Netpage 
Printer. The opposing player can of course also be a game-playing program running on the 
Netpage Network. 

An exploratory multi-player game (such as Ultima Online) can be presented as a Netpage. 
The Netpage shows the current view, the collection of items currently held, a map of the 
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area explored so far. and the chatter of nearby players. The form provides a text input field 
for chatting with other players, and command fields for navigating the game world. The 
submit button submits any chat text and navigation commands and produces an updated 
page. Previously printed pages form part of an evolving map of the game world, and pro- 
vide the basis for hyperjumping to different locations in the game world under the appro- 
priate circumstances. 

9.7 Consumer Electronics 

9.7.1 Netpage Digital Camera 

A Netpage Printer built into a digital camera is used both as a Netpage Printer and as a 
photo printer. A digital camera containing a Netpage Printer can provide the option of 
printing its photos as Netpages, thus providing-persistent storage of digital negatives on 
the Netpage Network. Each printed photo allows a pristine copy of itself to be produced at 
any time, even if the original print is severely degraded. 

The digital negative also records the date, time and location the photo was taken, and the 
settings of the camera at the time. It also records any artistic effect applied to the photo 
when it was printed [I], so that the actual output can be reproduced. 

The camera user can route photos to particular personal albums on the Netpage network. 
The user can grant other Netpage users (such as family members) access to particular 
albums. People can thus easily share photos without having to get together and swap neg- 
atives or prints. This may be particularly convenient when the camera user is travelling. 
The camera user may also choose to defer printing of photos while travelling, and instead 
retrieve and print the photos on returning home, possibly in the form of printed pages suit- 
able for inclusion in a normal photo album (see Section 9.6.2). 

9.8 Advertising 

9.8.1 Reverse-side Advertising 

In many highly interactive Netpage applications, much of the information is supplied to 
the user one printed sheet at a time, since this is the, minimum unit of Netpage output. 
Although a printed sheet has the capacity to hold two printed Netpages, i.e. one on each 
side of the sheet, there is in many cases insufficient information to fill two complete 
Netpages. When a sheet is printed with free space on the reverse side, unobtrusive adver- 
tising can be inserted. Although the immediate impact of the advertising is reduced 
because the advertising doesn't interrupt the user, the advertisement has persistence, and 
can be encountered some time after the interactive session if the user turns over the sheet 
while tidying up or archiving. 

The Netpage system detects sheets which are to be printed on one side only, and automati- 
cally prints selected advertising material on the reverse side. 

Although each user may have the ability to disable reverse-side printing of advertising, the 
Netpage system is likely to reward users for accepting advertising, since advertising and 
concomitant e-commerce provides the basis for subsidizing users' running costs. 
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9.9 Product Information and Registration 

9.9.1 Product Information 

The packaging of a product can be printed as one or more Netpages containing buttons 
which Imk to various kinds of information about the product. A milk carton might contain 
buttons Imked to information about the manufacturer, the product, the product in detail 
recipes which involve the product, and advertising promotions involving the manufacturer 
or product, such as competitions. A music compact disc might contain buttons which link 
to information about the band and about the songs on the disc itself A consumer product 
such as a television might contain a button which links to usage instructions. 

In each case the consumer presses the button with a Netpage pen and receives the linked 
information on the Netpage Printer. Information is always delivered in the language of the 
user. This is particularly useful in the case of consumer electronics products which are 
sold m international markets. 

Products can indicate both their instance identity (serial number) and class identity (uni- 
versa product code). Consumers can thereby obtain instance-specific information from 
the Netpage Network, such as known problems, recalls, use-by-date, etc as well as 
class-specific information, such as generic product information. 

9.9.2 Product Registration 

Further to Section 9.9.1, a product can also contain a <register> button which, when 
pressed with a Netpage Pen, registers the Netpage user as the owner of the product The 
user s contact information, which is already recorded on the Netpage System, is automati- 
cally transmitted to the product manufacturer who can record it in the their customer data- 
base. The registration process automatically adds the manufacturer to the user's e-mail 
contact list, thus allowing the manufacturer to send the user e-mail relevant to the product 
such as related special offers, recall notices, etc. If the manufacturer abuses their e-mail 
priveleges, the user can bar them in the usual way. 

9.9.3 Product Information via Universal Product Code Bar Code 

Many of the advantages of printing or affixing Netpages on the surfaces of products (as 
described m Section 9.9.1 above) can be gained by simply enhancing the Netpage Pen to 
decode the universal product code (UPC) bar codes which universally adorn products The 
pen transmits the UPC to the Netpage Printer, tagged as a UPC rather than as digital ink 
The printer constmcts a UPC-specific URI and locates the con-esponding resource on the 
Netpage Network via the DNS in the usual way. 

The request thus ultimately elicits printed product information. The product page can also 
include the facility to enter the serial number of the device and register the user's owner- 
ship of It via a <register> button, with all the advantages described in Section 9.9.2 above. 

Product manufacturers can thus gain the benefits of Netpage linking for their entire 
installed base of products without making alterations to the products themselves. 

9.9.4 Product Information via Help Button 

A physical help button can be installed in consumer devices such as televisions, kitchen 
appliances, etc.. The help button is coupled to a radio transceiver in the device which com- 
municates a information request to the nearest Netpage Printer. The request can consist of 
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just the universal product code (UPC) of the device, or can contain instance-specific infor- 
mation such as the serial number of the device as well. 

The information request is handled by the Netpage Printer in the same way as described in 
Section 9.9, 1 or Section 9.9.3 above, and ultimately elicits printed product information. 



Further to Section 9.9. 1 , the entire surface of a product can be printed as a Netpage. Press- 
ing on any part of the surface with a Netpage Pen can then elicit printed Netpage output 
which provides product-specific help. The help is either specific to the area pressed, or 
relates to the product as a whole. Thus the user of the product has instant access to helpful 
information about specific features of a product as well as the product as a whole. Each 
feature-specific help page is linked to the entire product manual. 



Further to Section 9.9.2 and Section 9.9,5, the entire surface of a product can be printed as 
a Netpage. Pressing on any part of the surface with a Netpage Pen can then elicit printed 
Netpage output which describes the product and its current ownership. 

After the product is purchased, pressing on any part of the surface automatically registers 
the product in the name of the owner of the Netpage Pen. 

Anyone can determine the ownership of a product offered for sale simply by pressing on 
any part of its surface with a Netpage Pen. 

Ownership can only be registered by a new owner if the current owner has relinquished 
ownership by signing the the "sell" portion of the product's status page. This places the 
product in an "un-owned" state. 

Product information and ownership is maintained either by the product manufacturer, as a 
service to its customers, or by a profit-oriented third party. A manufacturer-maintained 
product registration database has many advantages (see Section 9.9.2 above), but has the 
disadvantage that it may be abused for advertising purposes. A third-party-maintained 
product registration database has:the disadvantage that it.may incur a usage fee. 

The shipping computer system of a product manufacturer can automatically transfer own- 
ership of products from the manufacturer to the distributor or retailer, and so on down 
through the pre-sale chain. The retail computer system of the retailer can automatically 
mark each sold item as free, or transfer ownership directly to the holder of the payment 
card used to pay for the product. The customer can also use a Netpage Pen at the point of 
sale to register immediate ownership of the product. 

Traditional clearing-houses for stolen goods, such as pawn shops, can be required by law 
to check the ownership of all products presented to them. Since a Netpage-encoded prod- 
uct has an invisible encoding on most or all of its surface, it is difficult for a thief to 
remove it or even tell if it has been successfully removed. Conversely, it is incumbent on a 
potential buyer of a product to ensure that a clean reading can be obtained from its surface 
so that its ownership can be indisputably established. 

Where a product is leased or otherwise subject to complex or multiple ownership, the 
product registration database can refiect this and thus alert a potential buyer. 



9.9.5 



Context-Specific Product Help 



9.9.6 



Product Ownership Tracking 
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9.10 Geographic Information 

9-10.1 Route Planning 



An automobile navigation system typically determines the location of the car via GPS 
shows a local map to the driver on a color display, assist the driver in planning a route and 
gives the driver verbal instructions on following a route, cued to the changing location of 
he car. The Netpage System provides a convenient way for a driver to specify a destina- 
^on to the navigation system's route planner. The user can press on a location on a 
iNetpage street map and then press the <destination> button on the navrgation system The 
navigation system automatically programs the map location as the destination The' user 
also can press the <Iocation> button on an advertisement or on someone's business card 
and then press the <destination> button on the navigation system. This yields a potentially 
more accurate location than one derived from a map. 

The same technique allows a location to be specified as the destination to any route plan- 
ning system, for example one provided by the Netpage System itself. A Netpage route 
planning system accepts a destination location in the same way. It can assume that the 
s arting location is the location of the printer through which the user is interacting, but 
allows the user to explicitly specify a different starting location, as well as to modify the 
default route and specify route constraints in the usual way supported by route-planning 



9.10.2 Globe 



The surface of a globe, i.e. a sphere representing the earth, can be printed as a Netpage A 
user can then interact with the globe via the Netpage Pen. The user can request informa- 
tion about geographical features, cities, countries etc.; can request more detailed maps- 
can request the distance between two locations; can request a route including a number of 
locations; etc. In each case the Netpage Printer responds with the printed information. 

In the case of detailed maps, successively more detailed maps can be requested culminat- 
ing in street maps where available. Many different map views are possible, e g showing 
topography vegetation, annual rainfall, seasonal temperature, population, malaria inci- 
dence, etc. Multiple views can also be combined. 

The user can select a number of points of the globe simply by clicking on them in succes- 
sion with the pen. The user can also select a geographic, region, by circumscribing it with 
l"'''^''"^"^ operations, selected by pressing Netpage buttons printed on the base 
Of the globe or on a handy command card, act on the selected points or the selected region 
Uitterent command cards can be provided for users of different sophistication e " chil- 
dren and adults. ' 

Ideally the globe rolls freely on its base, rather than rotating on an axis, so that any area on 
Its surface can be rotated into view. A cupped base may be inset with ball bearings, for 
example. The surface of the globe is coated so that extended interaction with the base, as 
well as with the Netpage Pen, does not degrade the Netpage surface encoding. 

The globe can provide audio output as an alternative to printed output. This may be partic- 
ularly appropriate for interactive guessing games. The globe can ask the user to select the 
country which has a certain set of attributes or contains a certain geographic feature and 
can rate the choice or give a hint once the user makes a choice. Guessing games can in 
general involve any number of players, or just one player and the globe 
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10 Business Models 



10.1 System Principles 

The Netpage Network leverages the open technology and extensive infrastructure of the 
Internet. The widespread acceptance and growth of the Netpage Network is predicated on 
open competition rather than monopolistic practices. 

However, to provide an incentive to early investors, semi-exclusive licenses to Mem- 
jet-based Netpage Printer designs will be offered, as well as licenses to manufacture paper 
and ink consumables. 




Figure 5. Open structure of Intemetrbased Netpage Network 

The network supports any number of independent participants, some of which have com- 
plementary roles, and some of which compete. The open structure of the network is illus- 
trated in Figure 5. Content-related participants include the following: 

• news sources 

• publishers 

• news aggregators 

• freelance artists, writers, cartoonists 

• direct mailers 

• advertisers 

• advertising aggregators 

• banks 

• merchants 
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Infrastructure-related participants include the following: 

• server suppliers 

• network storage providers 

• communications carriers 

• Internet service providers (ISPs) 

• printer dealers 

• printer installation and servicing companies 

• ink and paper consumables dealers 

• consumables delivery companies 

Technology-related participants include the following: 

• research and development 

• chip makers (printheads, controllers, QA) 

• printer manufacturers 

• ink and paper consumables manufacturers 

The strength of the network lies in the fact that publication and delivery are completely 
decoupled This allows the deliveiy infrastructure to grow independently of the participa- 
tion of publishers. F 



1 0.2 Bootstrapping 



Because consumers are unlikely to be motivated to acquire a Netpage Printer until a vari- 
ety of publications and services are available, and because publishers will wait for an 
installed base before participating, the key to bootstrapping the network is to bundle the 
printer with a publication or service subscription, and possibly trimming profit margins in 
the growth stage. o r & 

There are several ways the manufacturing cost of the Netpage Printer, assumed to be well 
below $100, can be subsidized. Printer-based distribution can eliminate existing distribu- 
tion costs, offsetting the printer cost. The printer can provide a new mechanism for deliv- 
ering advertising, with advertising profits offsetting the printer cost. And the printer cost 
can be built into the subscription fee for a publication or service. 

The cost of printing and delivering a newspaper normally exceeds the price of subscrip- 
tion [27,5 1 ]. The real profit lies in the advertising. The cost of the Netpage Printer is easily 
exceeded by one years' cost savings, allowing a Netpage subscription, including a "free- 
printer, to be priced lower than a traditional subscription. A Netpage subscription offered 
to a customer already on the network would be priced correspondingly lower still. 

If the publication or service delivered via the Netpage Printer is sufficiently lucrative, then 
the publisher or provider may be able to subsidize not only the printer itself, but also its 
running costs. This can include Internet access, paper and ink consumables, and servicing. 
Demographics-informed advertising may fall into this category. The more information 
customers reveal about themselves, the greater the value of the advertising to the advertis- 
ers, and so the greater the level of subsidization that can take place. 

Early investors who subsidize the installation of Netpage Printers may be able to recover 
the mvestment and turn a profit merely by charging other publishers an access fee to the 
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printers they "own", perhaps for an interim period after installation, according to a net- 
work-wide agreement. They may also be able to earn commissions on click-throughs and 
e-commerce transactions originating on pages printed on "their" printers. 

Similar approaches are already emerging in the general Internet market. In the "FreePC" 
and related models [37], personal computers are bundled with Internet access, and the 
whole package is fully or partially subsidized by advertising and e-commerce. 

Most content-related participants in the Netpage Network, and even Internet service pro- 
viders, can benefit from directly investing in Netpage Printer deployment. 



Many of the bundling approaches are likely to remain applicable once the network 
becomes widely subscribed. . It . is possible that the bundling of the appliance (i.e. the 
Netpage Printer) with the service (be it Internet access or a publication subscription) will 
remain the dominant means of distributing the appliance, as it is in the cellular telephone 
market, and as an increasing number of companies, including IBM [18], are beginning to 
believe it should be in the personal computer market. 



News publishers with strong brands are likely to be able leverage those brands on the 
Netpage Network. They have an incentive to do so quickly to prevent newcomers from 
filling the vacuum and capturing the attendant advertising revenue. 

News publishers also have an incentive to migrate to the Netpage Network because it 
allows them to offer the more fme-grained targeting that advertisers are increasingly 
demanding, and which they are increasingly seeking elsewhere. 

News publishers who create content rather than simply aggregating other sources have a 
significant advantage, since they offer both unique content and an editorial voice. Users 
are more likely to choose a single news publication whose content and editorial orienta- 
tion they find useful, than specifying to a news aggregator how to glue together a number 
of disparate news sources. And any sufficiently strong news publication brand is unlikely 
to make its content available to an aggregator, since the. aggregator will be taking a pro- 
portion of advertising and e-commerce revenue. 

The Netpage Network, like the Web, offers lower barriers to entry than traditional publish- 
ing media, and this naturally stimulates greater diversity. However, the geographic inde- 
pendence of the network, coupled with built-in mechanisms for localization of 
publications, allows international, national and regional news publications to more easily 
compete in local news markets. 

The strength of a traditional local news publication lies partly in its local news content and 
partly in its local retail advertising and cleissified advertising content. Aggregation of clas- 
sified advertising is already happening on the Web, and the Netpage Network will make 
the same thing possible for local retail advertising. Local news publications are therefore 
likely to be excluded from the direct capture of local advertising, and may instead trans- 
form themselves into news gatherers feeding localized editions of larger publications. 



10-3 



Maturity 



10.3.1 News Publishers and News Aggregators 
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10.3.2 Advertising Aggregators 



The Netpage Network promises to be the most effective advertising medium ever con- 
ceived. !t combines the editorial and print quality of traditional publications with arbi- 
trarily finely targeted advertising, and provides a direct link between advertising, product 
information, and purchasing. 

Because personalization and localization are handled automatically by Netpage Publica- 
tion Servers, an advertising aggregator can provide arbitrarily broad coverage of both 
geography and demographics. The subsequent disaggregation is efficient because it is 
automatic. 

This makes it more cost-effective for publishers to deal with advertising aggregators than 
to directly capture advertising. Even though the advertising aggregator is taking a propor- 
tion of advertising revenue, publishers may find the change profit-neutral because of the 
greater efficiency of aggregation. 

Because of the finer targeting supported by the Netpage Network, publishers and advertis- 
ing aggregators have a larger advertising space to sell, leading to greater profits The link- 
ing between advertising, detailed product information, and purchasing and the 
corresponding measurability of consumer behavior, leads to greater profits from 
click-through fees and e-commerce commissions, benefiting publishers and advertising 
aggregators alike. ^ 

Added revenue from these fees and commissions may even allow users' costs - printer 
ink, paper, and Internet access - to be fully subsidized. 



10.3.3 Netpage Points 



One possible subsidization mechanism involves maintaining an account of Netpaee 
points" for each user. 

Netpage points are earned in proportion to the amount of advertising the user accepts 
Points are automatically deducted to cover the running costs of the printer The user can 
also redeem points for particular products and services offered on the Netpage Network 
some of which may only be available in exchange for points. Points cannot be redeemed 
tor cash. A user who has insufficient Netpage points can be billed directly for Netpage 
running costs. 

Netpage points may also be used more widely to reward a user for making purchases via 
the Netpage Network. 



10.3.4 Netpage Newspaper as Portal 



The front page of a personalized newspaper delivered via the Netpage Network can con- 
tain a standard set of category buttons, including for example: 



Books 

Clothing 

Electronics 

Entertainment 

Finance 

Groceries 

Health 
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• House and Garden 

• Looking Good 

• Music 

• Restaurants 

• Special Offers 

• Sports 

• Travel, and 

• Emergency 

Advertisers whose goods or services relate to the category of a particular button can buy 
the right to be linked to that button. Several levels of linking are possible. An advertiser 
can buy the entire link, so that the button leads directly to the advertiser's page. Or the 
advertiser can join a directory of advertisers who are linked to the button, so that the 
advertiser's page is linked to a (usually small) directory which is linked to the button. The 
publisher chooses how to deploy each button categoiy and each button instance. The pub- 
lisher can segment the button space of their subscriber base in arbitrary ways, for example 
by demographics, location, or simply proportionally to satisfy advertisers who wish to 
purchase a subset of the space. 

Certain category buttons, such as "Emergency", can link to non-advertising information 
specific to the user's location, and are provided as a service by the publisher. 

Web portals typically offer similar category buttons to advertisers. 
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1 Overview 

Netpage Printers are intended for use in domestic, commercial, corporate and hospitality 
environments. They all utilize pagewidth Memjet printheads [4], and are based on a sim- 
ple and reliable straight paper path, passing through a Memjet transfer roller printhead 
mechanism. In most cases the printed page is glued along one edge and adhered to the pre- 
vious page to form a final bound document diat can be 1 page or 500 pages thick. They all 
interact with the wireless Netpage Pen. 

Netpage Printers come in various forms: wall-mounting, tabletop, portable, and pocket 
versions. 



Confidential 



7 September 1999 



2 



Silverbrook Research 

■ Netpage Pn nter Design Description 

■ ^ _^draftva3 

2 Wallprinter 
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Figure 2. Wallprinter paper and ink cartridge access 



Confidenttai 



7 September 1999 



Silverbrook Research 



Netpage Printer Design Description 



draft vO.3 



Handle 



Sprung 
plater] 



Ink & Glue 
Cartndqe 

Ink bladder 



G\ue bladder 
Cor^r^ectore 

Ink hoee 
Glue hoee 
Motor assembly 
Glue wheel 

Glue wheel 
motor & cam 



5pfke wheel 
motor 



Power Supply 
Unit (110V) 



Faper tapper 
assembly 



Document 
collection tray 




Paper Tray 
On LED 

Ink LED 
Faper LED 
Error LED 

Flaten releaee 
Help button 

Faper Guides 

Pick-up roller 
Hinge 

Frlnthead assembly 



Printed page 
(being bound) 

Lower molding 



Printed 
document 



Figure 3. Wallprinter front elevation 



Confidential 



7 Septernber 1999 



6 



Silverbrook Research .1 * 

, Netpage Pnnter Des^ Description 



draftvO.3 



P aper tray 
molding 



Cover 

molding 

(clip-on 

Platen 
release 



Handle Chassis molding 



P aper 
qu\de 



frinthead 
assembly 

Glue 
wheel 

Glue wheel 
motor & cam 




Document 
collection 
tray 



Backplate 
(metal) 

Locking 
screw 

Hangers 
Fa per 

PCB 
Pata 

connector 

Pick-up 
roller 
assembly 

Spike 
wheele 

Ha ten 
runners 

Steel wire 
loop 

Platen motor 
& ^Irum 



^\nd\n0 
plazen 

Faper tapper 
assembly 

Exit Hatch 



Printed 
(document 



Figure 4. Wallprinter side elevation 



Confidential 



7 September 1999 



7 



Silverbrook Research 



Netpage Printer Design Description 



draft vO.3 



2.2 Wallprinter Pro 



This printer is similar to Wallprinter in most respects, except that it has a duplex 1 1 " print- 
head assembly, which prints on US Letter paper in a landscape format (see Figures 5, 6 
and 7). This means a faster print time and binding time for each page, making for faster 
overall document delivery. 

Another difference is the location of the ink cartridge, which resides above the paper tray 
rather than down the side. Each page is glued along the horizontal edge by a ftiU-length 
glue sponge, which is capped when not in use. Operation, printing, and document han- 
dlmg are identical to Wallprinter. 

Wallprinter Pro is fully customizable in finishes and color. 
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2.3 Wallprinter Pro R 



binding connguration of US Letter landscape 

era large Print'canridge^anrTdTe ee ^'reTs^'a^^^ Th ''^^^' "h''^' " 
C. M. Y. and infrared inks and glue as weMaTa 1000 she.?' ^''^"'^^'fs^ accommodates 
tridge can be recharged at nominated out^eK wh ^ '^^^""^ °^P"P"^- '^^^ 

ies by an authenticarion chip H , 2] " P™'"'^'"'' '*"°'^ '""'S^'- 

'^^y'^^r:::^^''' -^^^^'--^ - -PP- -isnt and a ba„ bearing t.ck 
Wallprinter Pro R is fully customizable in finishes and color 




Figure 8. Wallprinter Pro R, with print cartridg 



e extracted 



Confidential 



7 SeptembeF 1999 



11 



Silverbrook Research ^etpage Printer Design Description 



draft vO. 3 



Roll drive & Ink 
connector area 



Ink hose 
Glue hose 
Motor assembly 
Glue strip 

Glue strip 
motor & cam 



Spike wheel 
motor 



Power Supply 
Unit (IIOV) 



Faper tapper 
assembly 



Document 
collection tray 




Hatch 



Print roll 



On LED 



Printhead assembly 

nk LED 
Paper LED 
Error LED 

Help Button 



Printed paqe 
(bein^ bound) 

Lower molding 



Printed 
document 



Conftdentol 



Figure 9. Wallprinter Pro R front elevation 

7 September 1999 



12 



Silverbrook Research 

Netp age Printer Design Desr.hptinn ^ ^ 

draft vO. 3 



Print roll 



ink 

bladdere 



Cover 

molding 

(clip-on) 




Oocument 
collection 
tray 




Kear moldlnq 



^ackp\ate 
{metal) 

Locking 
ecrew 



bracket 
(matal) 

bearing 
aeeembly 



Spike 
whaeia 

Platen 
runnars 



Steel wire 
loop 

Flaten motor 
& drum 

^'md'mq 
platen 

PCB 



Exit Hatch 



F anted 
document 



Figure 10. Wallprinter Pro R side elevation 



Confidential 



7 September 1999 



13 



Silverbrook Research Netpage Printer Design Description 



draft vO.3 



3 Tableprinter 



3,1 Tableprinter Pro 

This printer is a tabletop version of the VVallprinter Pro. Essentially, it is the same printer 
unit with a base plinth that adds extra functionality, such as USB. parallel port and a power 
socket (see Figure 11). 

Tableprinter Pro is fully customizable in finishes and color. 




Figure 11. Tableprinter Pro 
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3.2 Tableprinter Pro R 



socket (see Figure 12) ^^n'^tionahty. such as USB, parallel port and a power 



Tableprinter Pro R is fully customizable in flni 



ishes and color. 




Figure 12. Tableprinter Pro R 



Confidential 



r Septeriioer 1 999 



15 



Silverbrook Research 



Netpage Printer Design Description 



draft vO.3 



4 Deskprinter 

4.1 Deskprinter Pro R 

The Deskprinter Pro R is a vertical format printer based around the large format print car- 
tridge (see Figures 13, 14, 15 and 16). This cartridge accommodates C, M, Y, Infrared inks 
and glue, as well as a 1000 page roll of paper. The print cartridge is lowered into the top of 
the unit through a latching hatch. When printing, the paper is fed through the printhead 
assembly where it is duplex printed and then ejected past a tuner which crops it into 
sheets. As the sheet passes the cutter, a glue wheel assembly glues along the long edge and 
powered spike rollers propel the sheet out into the binding area. 

The binding area consists of a binding platen which operates with a closed steel wire loop 
system of pulleys, runners and a powered axle. This provides the necessary speed to push 
the glued sheet forward onto the rear of a previous sheet, glue/bind it and return to the 
home position to accept the next printed sheet in less than 2 seconds. A motorized paper 
tapper assembly aligns the sheets in a simultaneous operation. 

When the document has been bound, a series of metal fingers at the top and bottom of the 
document rotate out of the way and the document is pushed into the out tray area. A pow- 
ered hatch opens and a motorized ejector assembly pushes the document through the exit 
slot of the unit. The hatch then closes onto the document ready for removal. Subsequent 
documents are stacked up in a similar fashion. The user interface is identical to the other 
printers in the range. A large PCB contains all the processing and external interface com- 
ponents and connects to an internal 1 10V/220V- power supply unit. ... 

Deskprinter Pro R is fully customizable in finishes and color. 




Figure 13. Deskprinter Pro R 
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Figure 15. Deskprinter Pro R plan 




Figure 16. Deskprinter Pro R elevation 
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5 Travel printer 
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Figure 17. Travelprinter R 
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Hiovmea on the side of the printer along with DC 3V input. 
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Figure 20. Trave.printer R detail, showing duplexed imaging units and print cartridge 
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Figure 21. Travelprinter plan and elevations 
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6 Microprinter 



6.1 Microprinter 



1^ hasTurint'?,' T'"'"'' P^^"^^'--- printer/camera (see Figures 2^ and ^3) 

o the Netal N network communication hardware and softCvare, aTlowing it to Fink 

Classic, Ho/v and s:^^^:::^''' 

a^nd MrZfT ^^T^^^^" ^ COOmm) page-width print canridge with C M Y 

Sats 3V0 ' ' .nu"'"'' '"^^"^ 'f^^ singfe-sided print 4T 

Netpages, 36 Class.c, 30 Horizontal or 1 8 Panoramic prints or any combination therTof 




'"'^"'^^^^ printer "-ear view with printing in prooress Heft) 
and front view with print cartridge extrlcted (rPght) ' 

Ipab^im?;^^^^^^^^^ ^^""^T -'^'^ auto focus and digital photo enhancement 

butt- :r ttTert ^'-'-^ - ---^ ^ 

^p==^:r:;rb,^^^^^^ 

runs from the main board to the imaajno chio in I cn ru u ^ 

■ fud^m^ cnip, an LCD, the prmthead assembly, the print- 
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head capping mechanism, a cutter assembly, the roll motor drive, various control switches 
and a CR2 batter^^ 

The Microprinter is fully customizable in fmishes and color 




Figure 23. Microprinter exploded view 
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Printer 
Controller 
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7 Memjet-Based Printing 



A Memjet printhead produces 1600 dpi bi-Ievel CMYK. On low-diffusion paper, each 
ejected drop forms an almost perfectly circular 22.5^m diameter dot. Dots are easily pro- 
duced in isolation, allowing dispersed-dot dithering to be exploited to its fullest. Since the 
Memjet printhead is the width of the page and operates with a constant paper velocity, the 
four color planes are printed in perfect registration, allowing ideal dot-on-dot printing. 
Since there is consequently no spatial interaction between color planes, the same dither 
matrix is used for each color plane. Dot-on-dot printing minimizes 'muddying' of mid- 
tones caused by inter-color bleed. 

A page layout may contain a mixture of images, graphics and text. Continuous-tone (con- 
tone) images and graphics are reproduced using a stochastic dispersed-dot dither. Unlike a 
clustered-dot (or amplitude-modulated) dither, a dispersed-dot (or frequency-modulated) 
dither reproduces high spatial frequencies (i.e. image detail) almost to the limits of the dot 
resolution, while simultaneously reproducing lower spatial frequencies to their full color 
depth, when spatially integrated by the eye. A stochastic dither matrix is careailiy 
designed to be free of objectionable low-frequency patterns when tiled across the image. 
As such its size typically exceeds the minimum size required to support a particular num- 
ber of intensity levels (e.g. 16x16x8 bits for 257 intensity levels): 

Human contrast sensitivity peaks at a spatial frequency of about 3 cycles per degree of 
visual field and then falls off logarithmically, decreasing by a factor of 100 beyond about 
40 cycles per degree and becoming immeasurable beyond 60 cycles per degree [7,8]. At a 
normal viewing distance of 12 inches (about 300mm), this translates roughly to 200-300 
cycles per inch (cpi) on the printed page, or 400-600 samples per inch according to 
Nyquist's theorem. 

In practice, contone resolution above about 300 ppi is of limited utilit>^ outside special 
applications such as medical imaging. Offset printing of magazines, for example, uses 
contone resolutions in the range 150 to 300 ppi. Higher resolu^tions contribute slightly to 
color error through the dither. 

Black text and graphics are reproduced directly using bi-level black dots, and are therefore 
not antialiased (i.e. low-pass filtered) before being printed. Text is therefore supersampled 
beyond the perceptual limits discussed above, to produce smoother edges when spatially 
integrated by the eye. Text resolution up to about 1200 dpi continues to contribute to per- 
ceived text sharpness (assuming low-diffusion paper, of course). 

The Netpage Printer uses a contone resolution of 267 ppi (i.e. 1600 dpi / 6), and a black 
text and graphics resolution of 800 dpi. 
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8 Document Data Flow 



be varied to match the input da!a I ^P^^^ <=an't 

therefore decoupled to nsu e .he or nthe^H7' ^'''"^^'^^ document printing are 
printed until it isMyrZZltdStl H u""'""' '""P'^ ^^^^ "^^^^ 

rasterized page image [™ory " ^ compressed version of each 

nn?;;hr::e%c^^^^^^^^^^^^ ^r'^-' - and 

tains a separate foreground bN evel blacklay^^^^^ ''"^^ 
biac. .aver is composited over the cont:nVS;:r»~ ^ 



Figure 24 shows the flow of a Netpage Printer document from network to printed page. 




Figure 24. Netpage Printer document data flow 

~L\';ZL'Zrl^r:^^^^^^^^^ °f '^^^ loss. 

"P.0 10:, ,„3„4':,--iHrrpr3:r;~T 

At 800 dpi, a Letter page of bi-level data has a size of 7mr r-^h , ^ 

compresses verv wpII luino i^o i " a size of /MB. Coherent data such as text 

Facsimile ^ '^«'"P'-ession. algorithms such as Group 4 

I .2. " li inoTcZoSL'r'""" ' • 'liscussed in SeCio^ 

-A giving a compressed page size of 0.8MB. 

uZ'^Zt'^,ZfuI'''^^ '^'^ ^^^"^''^'^ of bi-level data, 

the omimJ di^h "^'^P.^^".'^" algorithms on this data is pointless precisely because 
optimal d.ther ,s stochastic - ,.e. since it introduces hard-,o-compress disorder 
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The two-layer compressed page image format therefore exploits the relative strengths of 
lossy JPEG contone image compression and lossless bi-level text compression. The for- 
mat is compact enough to be storage-efficient, and simple enough to allow straightforward 
real-time expansion during printing. 

Since text and images normally don't overlap, the normal worst-case page image size is 
1.9MB (i.e. image only), while the normal best-case page image size is 0.8MB (i.e. text 
only). The absolute worst-case page image size is 2.7MB (i.e. text over image). Assuming 
a quarter of an average page contains images, the average page image size is 1. 1 MB. 
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9 Printer Controller 
Architecture 




i Iritefhet ''-d 




processor address, data and control bus 



I jpa^llel j/f"~^ j ^ 



serial i/f 



RIP DSP 




RIP DSP 



P""'"* I print I 

engine I engine I 




Memjet 
printhead 



Figure 25. Basic printer controller architecture 
The controlling processor handles 



less pens, controls the 
dies ink cartridge auth 
DSPs and print engines. It 



communication with the Internet and with local 



wire- 



med.um-perfon.ance generalpurpose micropro 



press^ci^a'^.^Src^rcCin e: re 3^:^^ ^^'-^^ -'"-"^ com- 

print engines print both sides of the page silitaneousiy' ""'^ ""^'^'''^ 

me w.reless pen. Additional pen-specific components in the 
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MEMS chip are not used in the printer controller. The Internet network interface module is 
separate, since Netpage Printers allow the network connection to be factory-selected. 
Flash memory and the 2x256Mblt (64MB) DRAM is also off-chip. 

Various Internet network interface modules can be supported. Possibilities include a POTS 
modem, a Hybrid Fiber-Coax (HFC) cable modem, an ISDN modem, a DSL modem, a 
satellite transceiver, a current or next-generation cellular telephone transceiver, a wireless 
local loop (WLL) transceiver, etc. A Internet connection may already be available on the 
local network, in which case only a local network connection may be required. 

The printer controller optionally includes a local network connection, to allow the printer 
to be used from a directly-connected workstation or over a local-area network. Possibili- 
ties include lOBase-Tand 100Base-T Ethernet, USB and USB 2.0, IEEE 1394 (Firewire), 
and various emerging home networking standards. 

The radio transceiver communicates in the unlicensed 900MHz band normally used by 
cordless telephones, and uses frequency hopping and collision detection to provide inter- 
ference-free communication. 

9.1 Detailed Document Data Flow 

The main processor receives and verifies the document's page layouts and page objects by 
Internet pointcast and multicast. It then runs the appropriate RIP software on the DSPs. 

The DSPs rasterize each page description and compress the rasterized page image. The 
main processor stores each compressed page image in memory. The simplest way to 
load-balance multiple DSPs is to let each DSP rastenze a separate page. The DSPs can 
always be kept busy since an arbitrary number of rasterized pages can, in general, be 
stored in memory. This strategy can lead to poor DSP utilization, however, when rasteriz- 
ing short documents. 

Watermark regions in the page description are rasterized to a contone-resolution bi-Ievel 
■ bitmap which is losslessly compressed to negligible size and which forms part of the com- 
pressed page image. 

The infrared (IR) layer of the printed page contains encoded position tags at a density of 
about 25 p'er inch: Each tag encodes the page id/ tag position, and control bits. Active 
areas and pressure-sensitive areas in the page description are rasterized to tag-resolution 
bi-level bitmaps which do not require compression and which form part of the compressed 
page image. 

The main processor passes back-to-back page images to the duplexed print engines. Each 
print engine stores the compressed page image into its local memory, and starts the page 
expansion and printing pipeline. Page expansion and printing is pipelined because it is 
impractical to store a 1 14MB bi-level CMY+IR page image in memory. 

The first stage of the pipeline expands the JPEG-compressed contone GMY layer, expands 
the Group 4 Fa.x-compressed bi-level watermark map, and expands the Group 4 Fax-com- 
pressed bi-level black layer, all in parallel. The second stage dithers the contone CMY 
layer using the dither matrix selected by the watermark map, and composites the bi-level 
black layer over the resulting bi-level CMY layer. Since there is no black ink used in the 
Netpage Printer, the black layer is composited with each of C, M and Y In parallel with 
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this, the tag encoder generates and encodes the bi-lpvpi rp t.r. a . . 

9-2 Print Engine Architecture 

position tag encoder and a custom inr^rf « custom halftoner/compos.tor unit, a custom 
in detail in Section 12 '° '^"'"J^^ P""''^^^''- ^--e described 



printer controHer bt« 




print engine 




. master, 
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Figure 26. Print engine architecture 
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10 Pen Controller Architecture 

The Netpage Pen controller consists of a controlling processor, a radio transceiver, a tilt 
sensor, a nib pressure sensor, a IR image sensor, flash memory, and 512KB of DRAM, as 
illustrated in Figure 27. 




Figure 27. Pen controller architecture 

The controlling processor capmres and decodes IR position tags from the page via the 
image sensor, monitors the tilt and pressure sensors, controls the autofocus voice-coil, 
controls the user interface (tricolor LED), and handles wireless communication with the 
local Netpage Printer. It consists of a medium-performance (-25MHz RISC) general-pur- 
pose microprocessor. 

Two-axis tilt sensing is provided by a two-axis accelerometer Nib pressure sensing is pro- 
vided by an IR emitter and photodiode pair in conjunction with a reflector coupled with 
the sprung nib. . 

The processor, digital transceiver components, 96x96 image sensor, flash memory and 
512KB DRAM are integrated in a single ASIC. The MEMS and analog RF components, 
accelerometers, and the IR emitter/photodiode are integrated in a single MEMS chip, also 
used in the Netpage Printer. 

The radio transceiver communicates in the unlicensed 900MHz band normally used by 
cordless telephones, and uses frequency hopping and collision detection to provide inter- 
ference-free communication. 
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Figure 28. Page structure 
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1 1 .2 Compressed Page Format 



Apart from being implicitly defined in relation to the printable page area, each page 
description is complete and self-contained. There is no data stored separately from the 
page description to which the page description refers. 

The page description consists of a page header which describes the size and resolution of 
the page, followed by one or more page bands which describe the actual page content. 

Table 1 shows the format of the page header. 

Table 1, Page header format 





^■::>-formarr^: 


•fiM{S:;H'V description, 


signature 


16-bit integer 


Page header format signature. 


version 


16-bit integer 


Page header format version number. 


structure size 


16-bit integer 


Size of page header. 


target resolution (dpi) 


16-bit integer 


Resolution of target page. This is always 
1600 for the Netpage Printer. 


target page width 


16-bit integer 


Width of target page, in dots. 


target page height 


16-bit integer 


Height of target page, in dots. 


target left margin 


16-bit integer 


Width of target left margin, in dots. 


target top margin 


16-bit integer 


Height of target top margin, in dots. 


bfack scale factor 


16-bit integer 


Scale factor from black resolution to target 
resolution (must be 2 or greater). 


black page width 


16-bit integer 


Width of black page, in black pixels. 


black page height 


16-bit integer 


Height of black page, in black pixels. 


contone scale factor 


16-bit integer 


Scale factor from contone resolution to tar- 
get resolution (must be 6 or greater). 


contone page width 


16-bit integer 


Width of contone page, in contone pixels. 


contone page height [ 16-bit integer 


Height of contone page, in contone pixels. 



The page header contains a signature and version which allow the print engine to identify 
the page header format. If the signature and/or version are missing or incompatible with 
the print engine, then the print engine can reject the page.. ....... 

The page header defines the resolution and size of the target page. The black and contone 
layers are clipped to the target page if necessary. This happens whenever the black or con- 
tone scale factors are not factors of the target page width or height. 

The target left and top margins define the positioning of the target page within the print- 
able page area. 

The black layer parameters defme the pixel size of the black layer, and its integer scale 
factor to the target resolution. 

The contone layer parameters deHne the pixel size of the contone layer, and its integer 
scale factor to the target resolution. 



Table 2 shows the format of the page band header. 
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Table 2. Page band header format 



^ ' field -S^/^i^^^^^^^/fr 



signature 



version 
structure size 



black band height 



format, 



16-bit integer 



16-bit integer 



16-bit integer 



black band data size 



contone band height 



contone band data size 



watermark map band data size 



16-bit integer 



32-bit integer 



Page band header format signature 



Page band header format version number 



Size of page band header. 



Height of black band, in black pixels. 



16-bit integer 



32-bit integer 




Size of black band data, in bytes. 



Height of contone band, in contone pixels. 



Size of contone band data, in bytes. 



data follows .he aclive area map data "'""We-stJe pressure-seitstt.ve area map 

P^'band'heTd*' """" " "" """"""'^ ^'"O wl.ich follows the 

3. Page band data format 



field 



black data 



contone data 



watermark map 



active area map 



pressure-sensitive area map 



forrnat - 


V ' ' .description ' ■'r'^'U- 


G4Fax 
bytestream 


Compressed bi-levei black data. 


JPEG 
bytestream 


Compressed contone CMY data. 


G4Fax 
bytestream 


Compressed bi-level watermark map data. 


bitmap 


Bi-level active area map data. 


bitmap 


Bi-ievel pressure-sensitive area map data 



Each 



variable-size segment of band data is aligned to an 8-byte boundary. 
The following sections describe the format of the ^ 



pressed contone laver. 



compressed bi-level layers and the com- 
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11.2.1 Bi-level Data Compression 

11.2. 1. 1 Group 3 and 4 Facsimile Compression 

The Group 3 Facsimile compression algorithm [12] losslessly compresses bi-levei data for 
transmission over slow and noisy telephone lines. The bi-level data represents scanned 
black text and graphics on a white background, and the algorithm is tuned for this class of 
images (it is explicitly not tuned, for example, for halftoned bi-level images). The ID 
Group 3 algorithm runlength-encodes each scanline and then Hufftnan-encodes the result- 
ing runlengths. Runlengths in the range 0 to 63 are coded with terminating codes. Run- 
lengths in the range 64 to 2623 are coded with make-up codes, each representing a 
multiple of 64, followed by a terminating code. Runlengths exceeding 2623 are coded 
with multiple make-up codes followed by a terminating code. The Huffman tables are 
fixed, but are separately tuned for black and white runs (except for make-up codes above 
1728, which are common). When possible, the 2D Group 3 algorithm encodes a scanline 
as a set of short edge deltas (0, ±1, ±2, ±3) with reference to the previous scanline. The 
delta symbols are entropy-encoded (so that the zero delta symbol is only one bit long etc.) 
Edges within a 2D-encoded line which can't be delta-encoded are runlength-encoded, and 
are identified by a prefix. ID- and 2D-encoded lines are marked differently. ID-encoded 
Imes are generated at regular intervals, whether actually required or not, to ensure that the 
decoder can recover from line noise with minimal image degradation. 2D Group 3 
achieves compression ratios of up to 6:1 [12]. 

The Group 4 Facsimile algorithm [6] losslessly compresses bi-level data for transmission 
over error-free communications lines (i.e. the lines are truly error-free, or error-correction 
is done at a lower protocol level). The Group 4 algorithm is based on the 2D Group 3 algo- 
rithm, with the essential modification that since transmission is assumed to be error-free, 
ID-encoded lines are no longer generated at regular intervals as an aid to error-recovery. 
Group 4 achieves compression ratios ranging from 20:1 to 60:1 for the CCITT set of test 
images [12]. 

The design goals and performance of the Group 4 compression algorithm qualify it as a 
compression algorithm for the bi-level layers. However, its Huffman tables are tuned to a 
lower scanning resolution (100-400 dpi), and it encodes runlengths exceeding 2623 awk- 
wardly. At 800 dpi, our maximum runlength is currently 6400. Although a Group 4 
decoder core might be available for use in the printer controller chip, it might not handle 
runlengths exceeding those normally encountered in 400 dpi facsimile applications, and so 
would require modification. 

11.2. 1.2 Edge Delta / Runlength (EDRL) Compression 

Since most of the benefit of Group 4 comes from the delta-encoding, a simpler algorithm 
based on delta-encoding alone is likely to meet our requirements. This approach, in the 
form of the Edge Delta / Runlength (EDRL) encoding, is described in detail in another Sil- 
verbrook design document [3]. There are therefore two viable approaches to losslessly 
compressing bi-level data: Group 4 Facsimile and EDRL. Their compression performance 
is compared below. Where this document refers to Group 4 Facsimile (G4Fax) compres- 
sion, EDRL can be substituted, purely as an implemetaiion decision. 

Magazine text is typically typeset in a typeface with serifs (such as Times) at a point size 
of 10. At this size a Letter page holds up to 14,000 characters, though a typical magazine 
page holds only about 7,000 characters. Text is seldom typeset at a point size smaller than 
5. At 800 dpi, text cannot be meaningfully rendered at a point size lower than 2 using a 
standard typeface. Table 4 illustrates the legibility of various point sizes. 
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^^^'e 4. Text at different point sizes 



point siza' 



9 

~10~ 



Ton jump* i»¥*r the itiy 



The quick hrowTi fox jump, over iha l»z> dog 



The quick brown fox jumps over the lazy dog. 



The quick brown Fox jumps over the lazy dog. 



The quick brown fox jumps over the lazy dog. 



The quick brown fox jumps over the lazy dog. 



The quick brown fox jumps over the lazy dog. 



Table 5. Group 4 and EDRL compression performance on text at 800 dpi 



point size 



icharacters' 
• per pagis ; ^ 



340,000 



170.000 



86,000 



15:^7 Group 4 5^"^ 
r compression 
X. ratio 



2.3 



3.2 



: compression 

■ ;>';^^iratib:'^-:^^ 



1.7 



59,000 



41.000 



28.000 



10 



11 



12 



13 



14 



15 



20 



21.000 
17,000 
14,000 



4.7 



5.5 



6.5 



7.7 



9.1 



2.5 



3.8 



4.9 



6.1 



7.4 



10.2 



12.000 



8,900 



8.200 



7,000 



5,800 



3,400 



10.9 



11.5 



13.5 



13.5 



14.6 



16.1 



19.8 



9.0 



10.4 



11.3 



12.4 



14.8 



15.0 



16.6 



18.5 



23.9 



vesica,,,. S.CH Z lTZT„tVS: Z^Ss"""" "" '" '«"'">' 



11.2, 1.3 Black Layer Compression Format 



The 800 dpi black layer is losslessly compressed using G4Fax (or EDRL) at a tvoical 
compression ratio exceeding i0:L ^ukl) at a typical 
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11.2,1,4 Watermark Map Compression Format 

The 267 dpi watemnark layer, which matches the 267 ppi contone color layer, is losslessly 
compressed using G4Fax (or EDRL) at a typical compression ratio exceeding 50: 1 . 

11.2.2 Contone Data Compression 

11.2.2.1 JPEG Compression 

The JPEG compression algorithm [9] lossily compresses a contone image at a specified 
quality level. It introduces imperceptible image degradation at compression ratios below 
5:1, and negligible image degradation at compression ratios below 10:1 [13]. 

JPEG typically first transforms the image into a color space which separates luminance 
and chrominance into separate color channels. This allows the chrominance channels to be 
subsampled without appreciable loss because of the human visual system's relatively 
greater sensitivity to luminance than chrominance. After this first step, each color channel 
is compressed separately. 

The image is divided into 8x8 pixel blocks. Each block is then transformed into the fre- 
quency domain via a discrete cosine transform (DCT). This transformation has the effect 
of concentrating image energy in relatively lower-frequency coefficients, which allows 
higher- frequency coefficients to be more crudely quantized. This quantization is the prin- 
cipal source of compression in JPEG. Further compression is achieved by ordering coeffi- 
cients by frequency to maximize the likelihood of adjacent zero coefficients, and then 
runlength-encoding runs of zeroes. Finally, the runlengths and non-zero frequency coeffi- 
cients are entropy coded. Decompression is the inverse process of compression. 

11.2.2.2 CMY Contone Layer Compression Format 

The CMY contone layer is compressed to an interleaved color JPEG bytestream. The 
interleaving is required for space-efficient decompression in the printer, but may restrict 
the decoder to two sets of Huffman tables rather than four (i.e. one per color channel) [13]. 
If luminance and chrominance are separated, then the luminance channels can share one 
set of tables, and the chrominance channels the other set. 

If luminance/chrominance separation is deemed necessary, either for the purposes of table 
sharing or for chrominance subsampling, then CMY is converted to YCrCb and Cr and Cb 
are duly subsampled. 

The JPEG bytestream is complete and self-contained. It contains all data required for 
decompression, including quantization and Huffman tables. 
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12 Print Engine 



1 2.1 Halftoner/Compositor 



The halftoner/compositor unit (HCU) (Figure 30) combines the functions of halftoning the 
contone CMY layer to bi-level CMY, and compositing the black layer over the halftoned 
contone layer. It also selects between the normal and the "watermark" dither matrix on a 
pixel-by-pixel basis, based on the corresponding value in the watermark map. 

The input to the HCU is an expanded 267 ppi CMY contone layer, an expanded 267 dpi 
watermark map, and an expanded 1600 dpi black layer The output from the HCU is a set 
of 1600 dpi bi-level CMY image lines. 

Once started, the HCU proceeds until it detects an end-of-page condition, or until it is 
explicitly stopped via its control register. 

The HCU generates a page of dots of a specified width and length. The width and length 
must be written to the page width and page length registers prior to starting the HCU. The 
page width corresponds to the width of the printhead. The page length corresponds to the 
length of the target page. 

The HCU generates target page data between specified left and right margins relative to 
the page width. The positions of the left and right margins must be written to the left mar- 
gin and right margin registers prior to starting the HCU. The distance fi-om the left margin 
to the right margin corresponds to the target page width. 

The HCU consumes black and contone/watermark data according to specified black and 
contone page widths. These page widths must be written to the black page width and con- 
tone page width registers prior to starting the HCU. The HCU clips black and contone data 
to the target page width. This allows the black and contone page widths to exceed the tar- 
get page width without requiring any special end-of-!ine logic at the input FIFO level. 

The relationships between the page width, the black and contone page widths, and the 
margins are illustrated in Figure 29. 



target left margin 



target page width 



target right margin 



black page width 



contone page width 



page width (of printhead) 



Figure 29. Relationships between page widths and margins 
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register prior to starting the HCU " """''"'^ scale faaor 

Halftoner/compositor control and configuration registers 




right margin 



page length 



black page width 



contone page 
width 



contone 
scale factor 



14 



14 



14 



Position of right margin, in dots. 



whfl '^"9"^ °' P"">e<l page, in dots. This is the number of lines ' 
which have to be generated for each page. 



^''^"^ of black layer, in dots. Used to detect the end of a bli^ 



Scale factor used to scale contone data to bi-level resolution. 



The consumer of the data oroduced bv the wri i »», • ■_ j • 

interface requires bi-level CMy IL a. h . f Pnnthead interface. The printhead 




I 3 bi-levet i 
' C. M. Y ) 
1^ FIFOs I 



r 3 bi-level 
' C. M. Y I 
' FIFOs I 



Figure 30. Halftoner/compositor unit 
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The input contone CM Y FIFO is a full 7KB line buffer. The line is used contone scale fac- 
tor times to effect vertical up-scaling via line replication. FIFO write address wrapping is 
disabled until the start of the last use of the line. 



12.1.1 Dither 

The dither unit converts a 24-bit contone CMY value into a 3-bit bi-level CMY value. 
Each color component is independently compared with the 8-bit threshold value at the 
current dot position in the dither cell (see Figure 31). 

There are two programmable 64x64x8-bit dither cells: a normal dither cell and a "water- 
mark" dither cell. The 1-bit watermark value associated with the current contone pixel 
controls the selection of the watermark or normal threshold value. 

The dither cell address generator contains a pair of 6-bit row and column address registers. 
Both registers are initialized to zero. The row address is incremented on every dot line 
advance, modulo 64. The column address is incremented on every dot clock, modulo 64, 
and is reset on a dot line advance. 



watermark 



dither cell 
address 
gnerator 



12 



12 



watermark 
dither cell 
64x64x8 



normal 
dither cell 
64x64x8 



comparator 



comparator 





A 
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/ 
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i 

T 
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Figure 31. Dither, with watermarking 

12.1.2 Composite 

The composite unit composites a black layer dot over a halftoned CMY layer dot. If the 
black layer opacity is one, then the halftoned CMY is set to black (i.e. all ones). The black 
layer opacity is therefore simply ORed with each of the halftoned C, M, and Y values. 



12.1.3 Clock Enable Generator 

The clock enable generator generates enable signals for clocking the contone CM Y/water- 
mark pixel input, the black dot input, and the CMY dot output. 

As described earlier, the contone pixel input buffer is used as both a line buffer and a 
FIFO. Each line is read once and then used contone scale factor times. FIFO write address 
wrapping is disabled until the start of the final replicated use of the line, at which time the 
clock enable generator generates a contone line advance enable signal which enables 
wrapping. 
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The clock enable generator also generates an even signal which is used to select th 
Table 7. Clock enable generator counter logic 




a. RP (reset page) condition; external signal 

b. EOL (end-of-line) condition: (D=0) a (BD=0) a (CD=0) 



output signal : 


condition ; v " 


output dot clock enable 


(D>0) A -nEOP^ 


black dot clock enable 


(LM=0) A (BD>0) a ^EOP 


contone pixel clock enable 


(LM=0) A (CD>0) a (CSP=0) a -.EOP 


contone line advance enable 


(CSL=0) A ^EOP 


even 


E=0 


margin 

■ ^ 


(LM=0) V (RM=0) 



a. EOP (end-of-page) condition: L=0 



12.2 Printhead Interface 

• MaxColors = 4 

• SegmentsPerXfer = 9 

• SegmentGroups = 2 
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Although the printhead interface has a number of external connections, not all used for an 
8/2'' printhead, so not all are connected to external pins on the print engine. Specifically, 
the value for SegmentGroups implies that there are only 2 SRCIock pins and 2 SenseSegSe- 
lect pins. All 36 ColorData pins are required, however. 

12.3 Position Tag Encoder 

The position tag encoder encodes the page id of the page being printed, together with the 
current x-y position on the page, into an error-correctably encoded position tag which is 
subsequently printed in infrared (IR) ink on the page. 

The position tag encoder takes the following as input: 

• the page id 

• a pressure sensitive area bitmap at tag resolution 

• an active area bitmap at tag resolution 

It writes a bi-level IR bitstream to the bi-level IR FIFO. The position tag encoder design as 
defined here allows a single page id per printed page, and provides for a page size of up to 
21.7 inches per dimension (17 x 4 x 512 / 1600). In addition, the position tag encoder 
allows for both landscape and portrait orientations. 

The position tag encoder consists of two stages connected by a buffer. The first stage, the 
tag data encoder, Reed-Solomon encodes the data to be placed in the tags. The second 
stage, the tag formatter, places the encoded data into the tag format and passes it on to the 
bi-level IR FIFO, Since the tag formatter runs one line of tags behind the tag data encoder, 
the tag data biiffer is in fact a double-buffer. The relationship is shown in Figure 32. 



printer controller bus ' ' . 




Figure 32. Two stages of position tag encoder 

The position tag encoder provides full macrodot-to-dot conversion, thereby eliminating 
any special knowledge of macrodots from the bi-level FIFO user. However, the position 
tag encoder itself does make use of the redundancy caused by dot replication in macrodot 
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formation with respect to the dot axis onlv SinrPfh^r>,o . 

tion tag encoder operates at ,/4 of trdof fre;^^^^^^^^^ M^" ' ■""^ ' 

12,3.1 Tag Data Buffer 

The tag data buffer therefore has the structure as shown by Figure 33: 

256 bits 



196 bits 



60 bits 



data bits for tag 0 


< 




data bits for tag 1 






data bits for tag 2 










data bits for tag T-l 


1 



unused 



Figure 33. Tag data buffer logical structure 



12.3.2 Tag Data Encoder 



The tag data encoder and control block functions are provided bv a .imnl. ,^ v 
core runnine at 60 MM^ Thic ^ • ui fJ'uviaea oy a simple microprocessor 

specific Reed So^lon . H ^°'"P^'-«d '^e design effort to implement a 

sructiln '"^ '^P^^ of encoding and specific tag codeword con- 
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The 196 bits of encoded tag data are written to one of the tag data buffers while the other 
is being read from by the tag formatter function. 

The coordinates encoded within the tags for a given line of tags will depend on the width 
of the printhead and whether or not the pages are being printed in portrait or landscape 
mode, as shown in Figure 34. 



increasing x 



i 




PORTRAIT 



increasing y 




LANDSCAPE 



Figure 34. Relationship of coordinates to tags in a tag line 

• If processing a portrait page, each printed line corresponds to changes in x coordi- 
nates. A printed line of tags therefore has a constant y coordinate, a start x coordinate 
of a, and end x coordinate ofT-I with a Ax of /. To advance to the next line of tags, the 
y coordinate increases by I and x is reset to 0. 

• If processing a landscape page, each printed line corresponds to changes in y coordi- 
nates, A printed line of tags therefore has a constant x coordinate, a start y coordinate 
of 0, and an end y coordinate of T-l with a Ay of /. To advance to the next line of tags, 
the X coordinate is decreased by 1 and y is reset to 0. 

The high level control function for coordinate generation is outlined here in pseudocode. 



if portraitMode 

For tagline = 0 to maxTagLines 
For tag = 0 to las tTaglnLine 

EncodeTag ( tag, pageld, tag, tagLine) 
EndFor 
EndFor 
else 

tagX = maxTagLines 
For tagline = 0 to maxTagLines 
For tag = 0 to las tTag I nLine 

EncodeTag ( tag, pageld, tagX, tag) 
tagX = tagX - 1 
EndFor 
EndFor 
Endlf 



In relation to the EncodeTag function, an examination of the tag structure reveals: 

• of the 168 data bits, 90 bits are copied to a maximum of 108 bits in the output with 
only trivial change. The remaining bits are generated check words based on GF(64). 
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• of the 28 mode bits, 8 bits are directly cooled to th^ n,.fr^.,f tu • • ^ 

crated check words based on GF(16) ^ remammg 20 are gen- 

Therefore the 8 mode bits output and at lea^f QO hitc r^ftu^ u-. 

wdtin'nroces? ' '''' -^er to simplify the 

Td hi K f I '■^^'^'"^ fomiatter) has random access to the eener 

• 90- 108 bits of data (1 5- 1 8 x 6-bit codewords, depending on whether Is or Os had to he 
nsened to generate non 000000 and non 111111 codewords) based on the 90 bits of data 

eso tl^n 7b t -fr T''""' ' "'^ ' '^^'^ ''^^ -^'^ bitm p t tag 

reseted bits) ^'^^^ resolution'and 6 

• 8 bits of mode data (2 x 4-bit codewords) 

• 20 bits of check words (5 x 4-bit check words) 



12,3.3 Tag Formatter 

Limes. I nis allows the tag- formatter to run at 1/4 of the dot rate. 

We use a simple set of counters for formatting a set of 68 lines of dots fa .et nf Hn.c 

.he »g encoding ,^c,u« wi,h ,H. o*r ^^41 il'^^^^^^^^^^^^ 

The lag fonnatter is shown in pseudocode form: 

For line = 0 CO 16 ~~ " ' 
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For docY = 0 to 3 

For tag = 0 to numTags InLine 
For pixel = 0 to 16 

adr - TableLookup [ line, pixel] 
If (adr5=0) 

bit = TagDataBuf fer [ tag I adro-4) 
Else 

bit = adrg 
Endlf 

Place 4 copies of bit in FIFO 
EndFor 
EndFor 
EndFor 
EndFor 

Swap TagDataBuf f ers 



The pseudocode is readily transferred to logic, as illustrated by Figure 35. 




r - -T- - . 

' bi-level ' 
' IR FIFO ' 



Figure 35. Tag formatter 
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13 Print Engine Driver 



This section discusses rasterizing pages to the internal compressed page format exn^.t.H 

hfdes'tE:;!"""^' " ^""1 1" ■ '^""^ ^'^'^ compress'ef page^ 'wh h 

The ret ''^T'.^^f P^"''^"^ ''^^avior from the higher-level raster image pTocessor mP) 

theVrl^ r" " T'" S^^P*^'" ^y^^^-' compressed page drLr and 

the print engine, is illustrated in Figure 36. unver, and 




Figure 36. RIP and print engine driver 

I^her at t"ht tgT'''" '^^^^''^^^^ ^^"^^'^ ^°-P— ^eHned' 

13.1 Graphics AND Imaging Model 

s?tha?rT''' '^°"P'"^ ^^'^l^ '^^^ S^^Ph'CS system used by the RIP 

so that the driver can provide device-specific handling for different Graphics an^ maoilo 

operations, mpanicular compositing operations and text operations ^ ^ ' 

The graphics system renders images and graphics to a nominal resolution specified bv the ' 
notext'In IT' riu""' ''T^ '^^^^ '° '^^^ con'tro ^f re^de,! 

prL ed olo r' n' P^"""''" information to the com- 

nrmma,^d::;t"::;,;:ir " - ^ '^'^^^ ---- 

L^'ice'rlsoTu^on' ZTVT'"' ""'^^ ' P^^^ 1^"^^- the nominal 

page driver manages the page buffer compressed 

13.2 TVvo-Layer Page Buffer 

^tle "^•^P^^^'^.P^S^ contains a 267 ppi contone layer and an 800 dpi black layer 

«v.. the contone layer by the print engine. The compressed page driver therefore main- 
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tains a page buffer which correspondingly contains a medium-resolution contone layer 
and a high-resolution black layer. 

The graphics systems renders and composites objects into the page buffer bottom-up - i.e. 
later objects obscure earlier objects. This works naturally when there is only a single layer, 
but not when there are two layers which will be composited later. It is therefore necessary 
to detect when an object being placed on the contone layer obscures something on the 
black layer. 

When obscuration is detected, the obscured black pixels are composited with the contone 
layer and removed from the black layer. The obscuring object is then laid down on the 
contone layer, possibly interacting with the black pixels in some way. If the compositing 
mode of the obscuring object is such that no interaction with the background is possible, 
then the black pixels can simply be discarded without being composited with the contone 
layer. In practice, of course, there is little interaction between the contone layer and the 
black layer, since images and text rarely overlap. 

The compressed page driver specifies a nominal page resolution of 267 ppi to the graphics 
system. Where possible the compressed page driver relies on the graphics system to render 
image and graphics objects to the pixel level at 267 ppi, with the exception of black text. 
The compressed page driver fields all text rendering requests, detects and renders black 
text at 800 dpi, but returns non-black text rendering requests to the graphics system for 
rendering at 267 ppi. 

Ideally the graphics system and the compressed page driver manipulate color in 
device-independent RGB, deferring conversion to device-specific CMY until the page is 
complete and ready to be .sent to the printer. This reduces page buffer requirements and 
makes compositing more rational. Compositing in in a device-dependent color Space is not 
ideal. 



Ultimately the graphics system asks the compressed page driver to composite each ren- 
dered object into the compressed page driver's page buffer. Each such object uses 24-bit 
contone RGB, and has an explicit (or implicitly opaque) opacity channel. 



page buffer 



medium-res 
contone layer 
(24-bit RGB) 



medium-res 
black layer 
(8-bit opacity) 



high-res 
black layer 
(1-bit opacity) 



B'A' X 1 r X 267 ppi^ S'/z" x 1 1 " x 267 ppi^ S'A' x 1 1 " x 800 dpi^ 

X 24-bit RGB = 19.1MB x 8-btt opacity = 6.4MB x l -bit opacity = 7.2MB 

Figure 37. Two-layer page buffer 

The compressed page driver maintains the two-layer page buffer in three parts. The first 
part is the medium-resolution (267 ppi) contone layer. This consists of a 24-bit RGB bit- 
map. The second part is a medium-resolution black layer. This consists of an 8-bit opacity 
bitmap. The third part is a high-resolution (800 dpi) black layer. This consists of a 1-bit 
opacity bitmap. The medium-resolution black layer is a subsampled version of the 
high-resolution opacity layer. In practice, assuming the medium resolution is an integer 
factor n of the high resolution (e.g. n = 800 / 267 = 3), each medium-resolution opacity 
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13.3 



va ue .s obtained by averagmg the corresponding n x n high-resolution opacity values 
Th corresponds to box-filtered subsampling. TT,e subsampling of the black pixels effec: 
anttaltases edges .n the high-resolution black layer, thereby reducing dngiL aS 
facts when the contone layer is subsequently JPEG-compressed and decompressed 

The structure and size of the page buffer is illustrated in Figure 37. 

Compositing Model 



fng'varirblS'''" P^S^ buffer compositing model, we define 



Table 9. Compositing variables 



the follow- 



variable 




resolution 


\'Y- > format v./.;'^^"-"^ 


n 


medium to high resolution scale factor 






Cc 


contone layer color 


medium 


8-bit color component 


Cg 


contone object color 


medium 


8-bit color component 


«G 


contone object opacity 


medium 


8-bit opacity 




medium-resolution black layer opacity 


medium 


8-bit opacity 




black layer opacity 


high 


1-bit opacity 


Or 


black object opacity 


high 


1-bit opacity 



When a black object of opacity is composited with the black laver, the black lave 
updated as follows: . ^ 



r IS 



a. 



V Qt 



(1) 



r. - I n - I 



I = oy = 0 



(2) 



Jn^ol'tZTl'^- "'S °P^^'^ (Eq- ' >' ^he correspond- 

blLkVer (Eq. is re-computed from the high-resoiution 

When a contone object of color and opacity is composited with the contone layer, 
the contone layer and the black layer are updated as follows: 





= Q 


.(1 -a^, ) if (ttc >0) 


(3) 




= 0 i 


f (ac_ >0) 


(4) 




= 0 i 


(«c ,„>0) 


(5) 








(6) 



Wherever the contone object hides the black layer, even if not fully opaquely, the affected 
black layer p.xels are composited with the contone layer (Eq. 3) and removed from the 
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black layer (Eq. 4 and Eq. 5). The contone object is then composited with the contone 
layer (Eq. 6). 



Once page rendering is complete, the compressed page driver converts the contone layer 
to printer-specific CMY with the help of color management functions provided by the 
graphics system. 

The compressed page driver then compresses and packages the black layer and the con- 
tone layer into the compressed page format defined in Section 11. This is subsequently 
expanded in real time by the print engine. 

The forward discrete cosine transform (DCT) is the costliest part of JPEG compression. In 
current high-quality software implementations, the forward DCT of each 8x8 block 
requires 12 integer multiplications and 32 integer additions [10]. This places a trivial addi- 
tional load on each KIP DSP. 



13.4 



Page Compression 
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14 Memjet Printhead 

A Memjet printhead is a drop-on-demand 1600 dpi inkjet printer that produces bi-level 
dots in up to 4 colors to produce a printed page of a particular width. Since the printhead 
prints dots at 1600 dpi, each dot is approximately 22.5|im in diameter, and spaced 
15.875}am apart. Because the printing is bi-level, the input image should be dithered or 
error-dif¥ijsed for best results. 




Figure 38. A Memjet printhead 

A Memjet printhead is composed of a number of identical 1/2 inch Memjet segments. The 
segment is therefore the basic building block for constructing a printhead. 



14.1 The Structure of a Memjet Segment 

This section examines the structure of a single segment, the basic building block for con- 
structing Memjet printheads. 

14.1.1 . Grouping of Nozzles Within a Segment 

The nozzles within a single segment are grouped for reasons of physical stability as well 
as minimization of power consumption during printing. In terms of physical stability, a 
total of 10 nozzles share the same ink reservoir. In terms of power consumption, groupings 
are made to enable a low-speed and a high-speed printing mode. 

Memjet segments support two printing speeds to allow speed/power consumption 
trade-offs to be made in different product configurations. 

In the. low-speed printing m.ode, 4 nozzles. of. each .color are fired from the segment at a 
time. The exact number of nozzles fired depends on how many colors are present in the 
printhead. In a four color (e.g. CMYK) printing environment this equates to 16 nozzles fir- 
ing simultaneously. In a three color (e.g. CMY) printing environment this equates to 12 
nozzles firing simultaneously. To fire all the nozzles in a segment, 200 different sets of 
nozzles must be fired. 
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In the high-speed printing mode, 8 nozzles of each rr,lr^^ a r 

time. The exact number of nozz es fire^ depends on how ^""^ ' 

printhead. In a four color (e o CiVlYS nnST P'^'^"' '^^^ 

ing simultaneously. In a tt^e clr ( 'g^CMYrpl^^^^^^ ''""".'^ 

^4. f . 1. 1 10 Nozzles Make a Pod 

15.875um grid to nrint i Ann c P™f"ces dots 22.5nm m diameter spaced on a 




Figure 39. A single pod. numbered by firing order 

o o o o ® 
o o o o o 

Figure 40. A single pod, numbered by load order 
14. 1.1.2 1 Pod of Each Color Makes a Chromapod 

coToT) -^e ex JcteH "^^^^ ^ P^ds per chromapod (one pod ofeach 

(cyan ien^v Un^ ^ ^^f^^-^P^d is 4, as used in a CMYK 

of 4 co^s u Y ' H '""'"^ '^''^"^ (^"^'^ ^ '^^^'^'^P P^i"'-^)- This maximum 
colors .s not imposed by any physical constraints - it is merely an expected maximum 
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from the expected applications (of course, as the number of colors increases the cost of the 
segment increases and the number of these larger segments that can be produced from a 
single silicon wafer decreases). 

A chromapod represents different color components of the same horizontal set of 10 dots 
on different lines. The exact distance between different color pods depends on the Memjet 
operating parameters, and may vary from one Memjet design to another. The distance is 
considered to be a constant number of dot-widths, and must therefore be taken into 
account when printing: the dots printed by the cyan nozzles will be for different lines than 
those printed by the magenta, yellow or black nozzles. The printing algorithm must allow 
for a variable distance up to about 8 dot-widths between colors. Figure 41 illustrates a sin- 
gle chromapod for a CMYK printing application. 




Figure 41. A Single Chromapod Contains 1 Pod of each Color 

14, 1. 1.3 5 Cbromapods Make a Podgroup 

5 chromapods are organized into a single podgroup. A podgroup therefore contains 50 
nozzles for each color. The arrangement is shown in Figure 42, with chromapods num- 
bered 0-4 and using a CMYK chromapod as the example. Note that the distance between 
adjacent chromapods is exaggerated for clarit\'. 

0 12 3 4 



"ZO^ "ZO^ ' 5 chromapods 



Figure 42. A Single Podgroup Contains 5 Chromapods 

14. 1.1.4 2 Podgroups Make a Phasegroup 

2 podgroups are organized into a single phasegroup. The phasegroup is so named because 
groups of nozzles within a phasegroup are fired simultaneously during a given firing 
• phase (this is explained in more detail below). The formation of a phasegroup from 2 pod- 
groups is entirely for the purposes of low-speed and high-speed printing via 2 Pod- 
groupEnable lines. . . 

During low-speed printing, only one of the two PodgroupEnable lines is set in a given fir- 
ing pulse, so only one podgroup of the two fires nozzles. During high-speed printing, both 
PodgroupEnable lines are set, so both podgroups fire nozzles. Consequently a low-speed 
print takes twice as long as a high-speed print, since the high-speed print fires twice as 
many nozzles at once. 
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Figure 43. A single phasegroup contains 2 podgroups 
14. 1.1.5 2 Phasegroups Make a Firegroup 

III ffi'?'"""' .(f^'^^\^S™"PA PhasegroupB) are organized into a single flregroup 
w,th 4 flregroups ,n each segment. Firegroups are so named because they alffire thf same 
nozzles simultaneously. Two enable lines, AEnable and BEnable, allow^he firing of Pha 
segroupA nozzles and PhasegroupB nozzles independently as different firinrphies The 
aTdX'^far-; ^'^"^^ ^'^^^^ ^etween^acent grou^^st ^^'er! 




^ \ A single Firegroup 

\ contains 2 phasegroups 




p1^;co^'''*'°"^«P^^^*^^^" Segments. Firegroups. 
Phasegroups, Podgroups and ChromaPods 
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14,1.1.6 Nozzle Grouping Summary 

Table 10 is a summary of the nozzle groupings in a segment assuming a CMYK chroma- 
pod. 



Table 10, Nozzle Groupings for a single segment 











Nozzle 


Base unit 


1:1 


1 


Pod 


Nozzles per pod 


10:1 


10 


Chroma pod 


Pods per chromapod 


C:1 


IOC 


Podgroup 


Chromapods per podgroup 


5:1 


50C 


Phasegroup 


Podgroups per phasegroup 


2:1 


100C 


Firegroup 


Phasegroups per firegroup 


2:1 


200C 


Segment 


Firegroups per segment 


4:1 


800C 



The value of C, the number of colors contained in the segment, determines the total num- 
ber of nozzles. 

• With a 4 color segment, such as CMYK, the number of nozzles per segment is 3,200. 

• With a 3 color segment, such as CMY, the number of nozzles per segment is 2,400. 

• In a monochrome environment, the number of nozzles per segment is 800. 

14.1.2 Load and Print Cycles 

A single segment contains a total of 800C nozzles, where C is the number of colors in the 

segment, A Prim Cycle involves the firing of up to all of these nozzles, dependent on the 
information to be printed. A Load Cycle involves the loading up of the segment with the 
information to be printed during the subsequent Print Cycle. 

Each nozzle has an associated NozzleEnahle bit that determines whether or not the nozzle 
will fire during the Print Cycle. The NozzleEnahle bits (one per nozzle) are loaded via a 
set of shift registers. 

Logically there are C shift registers per segment (one per color), each 800 deep. As bits 
are shifted into the shift register for a given color they are directed to the lower and Upper 
nozzles on alternate pulses. Internally, each 800-deep shift register is comprised of two 
400-deep shift registers: one for the upper nozzles, and one for the lower nozzles. Alter- 
nate bits are shifted into the alternate internal registers. As far as the external interface is 
concerned however, there is a single 800 deep shift register. 

Once all the shift registers have been fully loaded (800 load pulses), all of the bits are 
transferred in parallel to the appropi-iate NozzleEnahle bits. This equates to a single paral- 
lel transfer of 800C bits. Once the transfer has taken place, the Print Cycle can begin. The 
Print Cycle and the Load Cycje can occui; simultaneously as long as the parallel load of all 
NozzleEnahle bits occurs at the end of the Print Cycle. 

14,1.2.1 Load Cycle 

The Load Cycle is concerned with loading the segment's shift registers with the next Print 
Cycle's NozzleEnahle bits. 
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Each segment has C inputs directly related to the C shift registers Twhere C \<. tu. 
example, a 4 color segment would have 4 inputs labeled ColorlData CoZ2Da^n 

resnect^^^^^^ . registers^ Alternate pulses transfer bits to the lower and upper noLles 
Soc b.l:- transfer of data OncTal 

transfer of data from the shift registers to the appropriate NozzIeEnable bits. 

The parallel transfer via a pulse on PTransfer must take place after the Print Cycle ha. fin 
«shed. Otherwise the NozzieEnable bits for the line being printfd H be i^^^^ 

Prlm*7vrrnr '''' ^'^^-^^ P^-^^^ ^--g the same 
^nnt Cycle, do not appear on the same physical output line. The physical separation of 
Odd and even nozzles within the printhead, as well as separation bet^l nL es "^^^^^^ 
differe '"'"T '''' '''^ ^'^^"^^ ^^^^ ^" ^*^^^^"t lines of the page This ret dve 
t?nTe : ? ^T"'''/^^ ^^^''"^ ^^^^ printheL^he actu 1 d f! 

head The d f f ' ^ V ^^^^^^^^''•^tics of the inkjet mechanism used in the print- 

S tween 'f'""' ^' -^-^ ^' - the disLce 

CO ^Ta^^^^^^^^^ ^-tance between nozzles of the same 

color. Table 1 1 shows the dots transferred to a C color segment on the first 4 pulses. 

Table 11 Order of Dots Transferred to a Segment 



Pulse 



1 
2 

3 



Dot 



0 
1 

2 
3 



Color! Line ; 



N 

N+D2^ 

N 

N+D2 



Coior2 Line : 



N+Di^ 
N+D1+D2 

N+D, 
N+D1+D2 



CoIor3 Line 



M+2D1+D2 

N+2Di 
N+2D1+D2 



Colore Line 



N+(C-1)Di 
N+(C-1)Di+D2 

N+(C-1)Di 
N+(C-1)Di+D2 



a. Di = number of lines between the nozzles of one color and the next (likely = 4-8) 

b. D2 - number of lines between two rows of nozzles of the same color (likely = 1 ) 

And so on for all 800 pulses. 

14.1.2.2 Print Cycle 

c^on1umemZ'''h IT'"' ''^"'"'"^ them all at once would 

T^Zo^.T^^T"''"'' problematic in terms of ink refill and nozzle interference. 

modes a e'efieH ^ '!f Consequently two firing 

modes are defined, a low-speed pnntmg mode and a high-speed printing mode: 

. In the low-speed prm, mode, there are 200 phases, with each phase firing 4C nozzles 
per firegroup, where C is the number of colors). 

• In the high-speed print mode, there are 100 phases, with each phase firing 8C nozzles. 

(2C per firegroup, where C is the number of colors). 
The nozzles to be fired in a given firing pulse are determined by 
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• 3 bits ChromapodSelect (select 1 of 5 chromapods from a firegroup) 

• 4 bits NozzleSelect (select 1 of 10 nozzles from a pod) 

• 2 bits of PodgroupEnable lines (select 0, 1, or 2 podgroups to fire) 

When one of the PodgroupEnable lines is set, only the specified Podgroup's 4 nozzles will 
fire as determined by ChromapodSelect and NozzleSelect. When both of the PodgroupEn- 
able lines are set, both of the podgroups will fire their nozzles. For the low-speed mode, 
two fire pulses are required, with PodgroupEnable = 10 and 01 respectively. For the 
high-speed mode, only one fire pulse is required, with PodgroupEnable ==11. 

The duration of the firing pulse is given by the AEnable and BEnable lines, which fire the 
PhasegroupA and PhasegroupB nozzles from all firegroups respectively. The typical dura- 
tion of a firing pulse is 1 .3 - 1 .8 |is. The duration of a pulse depends on the viscosity of the 
ink (dependent on temperature and ink characteristics) and the amount of power available 
to the printhead. See Section 14.1.3 on page 61 for details on feedback ft-om the printhead 
in order to compensate for temperature change. 

The AEnable and BEnable are separate lines in order that the firing pulses can overlap. 
Thus the 200 phases of a low-speed Print Cycle consist of 100 A phases and 100 B phases, 
effectively giving 100 sets of Phase A and Phase B. Likewise, the 100 phases of a 
high-speed print cycle consist of 50 A phases and 50 B phases, effectively giving 50 
phases of phase A and phase B. 

Figure 45 shows the AEnable and BEnable lines during a typical Print Cycle. In a high- 
speed print there are 50 2|is cycles, while in a low-speed print there are 100 2)is cycles. 

Nominal * ' 



AEnable 




BEnable 




Figure 45. AEnable and BEnable During a Typical Print Cycle 



For the high-speed printing mode, the firing order is: 



ChromapodSelect 0, NozzleSelect 0, PodgroupEnable 
ChromapodSelect 1, NozzleSelect 0, PodgroupEnable 
ChromapodSelect 2, NozzleSelect 0, PodgroupEnable 
ChromapodSelect 3, NozzleSelect 0, PodgroupEnable 
ChromapodSelect 4, NozzleSelect 0, PodgroupEnable 
ChromapodSelect 0, NozzleSelect 1, PodgroupEnable 



(Phases A and B) 
(Phases A and B) 
(Phases A and B) 
(Phases A and B) 
(Phases A and B) 
(Phases A and B) 



ChromapodSelect 3, NozzleSelect 9, PodgroupEnable 
ChromapodSelect 4, NozzleSelect 9, PodgroupEnable 



(Phases A and B) 
(Phases A and B) 
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For the low-speed printing mode, the firing order is similar. For each phase of the hieh 
speed mode where PodgroupEnable was 11 , two phases of PodgroupEnable = 0 and 
are substituted as follows: and lo 

• ChromapodSelect 0, NozzleSelect 0, PodgroupEnable 0 1 (Phases A and B) 

• ChromapodSelect 0, NozzleSelect 0, PodgroupEnable 1 0 (Phases A and B) 

• ChromapodSelect I . NozzleSelect 0, PodgroupEnable 0 1 (Phases A and B) 

• ChromapodSelect I , NozzleSelect 0, PodgroupEnable 10 (Phases A and B) 

• 

• ChromapodSelect 3, NozzleSelect 9, PodgroupEnable 01 (Phases A and B) 

• ChromapodSelect 3, NozzleSelect 9, PodgroupEnable 1 0 (Phases A and B) 

• ChromapodSelect 4, NozzleSelect 9, PodgroupEnable 0 1 (Phases A and B) 

• ChromapodSelect 4, NozzleSelect 9, PodgroupEnable 1 0 (Phases A and B) 

^ore th?r^n, r'"' a approximately 100ns to refill. The nozzle cannot be fired 

In fS. h h "'^P^^^- This limits the fastest printing speed to lOO^s per line. 

In the h.gh-speed prmt mode, the time to print a line is lOO^is, so the time between firing a 

sTowtr thTth ? "^^^^ '°^^-^P^^d P""t mode is 

Slower than this, so is also acceptable. 

The firing of a nozzle also causes acoustic perturbations for a limited time within the com- 
rothTr pod- The perturbations can interfere with the firing of 

sholld be o'^'r I Consequently, the firing of nozzles within a pod 

chromapod (one nozzle per color) and then move onto the next chromapod within the pod- 

• In the low-speed printing mode the podgroups are fired separately. Thus the 5 chroma- 
pods vv.thm both podgroups must all fire before the first chromapod fires again, total- 
Img 1 0 X 2.US cycles. Consequently each pod is fired once per 20.us. 

• In the high-speed printing mode, the podgroups are fired together. Thus the 5 chroma- 
pods wuhm a smgle podgroups must all fire before the first chromapod fires again, 
totallmg 5 X 2ns cycles. Consequently each pod is fired once per 1 0 ns. 

tte resonanfir" '"^rT ^''"'^'^ '""^ around I500m/s, 

the resonant frequency of the mk channel is 2.5MHz. Thus the low-speed mode allows 50 

namTv^l^.'^^ ' P"''" ^""^P""' ""'^ high-speed mode allows 25 reso- 

nant cycles. Consequently any acoustic interference is minimal in both cases 
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14.1.3 Feedback from a Segment 

A segment produces several lines of feedback. The feedback lines are used to adjust the 
timing of the firing pulses. Since multiple segments are collected together into a printhead, 
it is effective to share the feedback lines as a tri-state bus, with only one of the segments 
placing the feedback information on the feedback lines. 

A pulse on the segment's SenseSegSelect line ANDed with data on ColorlDaia selects if 
the particular segment will provide the feedback. The feedback sense lines will come from 
that segment until the next SenseSegSelect pulse. The feedback sense lines are as follows: 

• Tsense informs the controller how hot the printhead is. This allows the controller to 
adjust timing of firing pulses, since temperature affects the viscosity of the ink. 

• Vsense informs the controller how much voltage is available to the actuator. This 
allows the controller to compensate for a flat bauery or high voltage source by adjust- 
ing the pulse width. 

• Rsense informs the controller of the resistivity (Ohms per square) of the actuator 
heater. This allows the controller to adjust the pulse widths to maintain a constant 
energy irrespective of the heater resistivity. 

• Wsense informs the controller of the width of the critical part of the heater, which may 
vary up to ± 5% due to lithographic and etching variations. This allows the controller 
to adjust the pulse width appropriately. 

14.1.4 Preheat Cycle 

The printing process has a strong tendency to stay at the equilibrium temperature. To 
ensure that the first section of the printed photograph has a consistent dot size, the equilib- 
rium temperature must be met before printing any dots. This is accomplished via a preheat 

cycle. 

The Preheat cycle involves a single Load Cycle to all nozzles of a segment with Is (i.e. 
setting all nozzles to fire), and a number of short firing pulses to each nozzle. The duration 
ofthe pulse must be insufficient to fire the drops, but enough to heat up the ink. Altogether 
about 200 pulses for each nozzle are required, cycling through in the same sequence as a 
standard Print Cycle. 

Feedback during the Preheat mode is provided by Tsense, and continues until equilibrium 
temperature is reached (about 30° C above ambient). The duration of the Preheat mode is 
around 50 milliseconds, and depends on the ink composition. 

Preheat is performed before each print job. This does not affect performance as it is done 
while the data is being transferred to the printer. 

14.1.5 Cleaning Cycle 

In order to reduce the chances of nozzles becoming clogged, a cleaning cycle can be 
undertaken- be fore each print job. Each nozzle is fired a.numberof times into an absorbent 

sponge. 

The cleaning cycle involves a single Load Cycle to all nozzles of a segment with Is (i.e. 
setting all nozzles to fire), and a number of firing pulses to each nozzle. The nozzles are 
cleaned via the same nozzle firing sequence as a standard Print Cycle. The number of 
times that each nozzle is fired depends upon the ink composition and the time that the 
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pnntej has ben idle. As with preheat, the cleaning cycle has no effect on printer perfor- 



14.1 .6 Printhead Interface Summary 

Each segment has the following connections to the bond pads: 
Table12. Segment Interface Connections 





onromapod Select 


3 


Selsct whiph f^h rnm far\j-kW mill f.^^ /n a\ ~" 

tjcicv^i wiii^M unromapoa win tire (0-4) 


NozzleSelect 


4 


wMiL^ii fioizie rrom me pod will fire (0-9) 


PodgroupEnable 


2 


i-n<auic iiie poagroups 10 Tire (choice of: 01 , 10, 11) 


AEnable 


1 


Firing pulse for podgroup A 


BEnable 


1 


Firing pulse for podgroup B 


ColorNData 


C 


Input to shift registers (1 bit for each of C colors in the segment) 


SRCIock 


1 


A pulse on SRCIock (ShiflRegisterClock) loads C bits from Color- 
Data into the C shift registers. 


PTransfer 


1 


Parallel transfer of data from the shift registers to the internal 
NozzleEnabie bits (one per nozzle). 


SenseSegSelect 


1 


A pulse on SenseSegSelect ANDed with data on Colon Data 
selects the sense lines for this segment. 


Tsense 


1 


Temperature sense 


Vsense 


1 


Voltage sense 


Rsense 


1 


Resistivity sense 


Wsense 


1 


Width sense 


Logic GND 


1 


Logic ground 


Logic PWR 


1 


Logic power 


V- 


21 


Actuator Ground 


V+ 


21 


Actuator Power 


TOTAL 


62+C 


(if C ts 4, Total = 66) 
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14.2 Making Memjet Printheads out of Segments 

A Memjet printhead is composed of a number of identical 1/2 inch printhead segments. 
These 1/2 inch segments are manufactured together or placed together after manufacture 
to produce a printhead of the desired length. Each 1/2 inch segments prints 800 1600 dpi 
bi-level dots in up to 4 colors over a different part of the page to produce the final image. 
Although each segment produces 800 dots of the final image, each dot is represented by a 
combination of colored inks. 

A 4-inch printhead, for example, consists of 8 segments, typically manufactured as a 
monolithic printhead. In a typical 4-color printing application (cyan, magenta, yellow, 
black), each of the segments prints bi-level cyan, magenta, yellow and black dots over a 
different part of the page to produce the final image. The positions of the segments are 
shown in Figure 46. 



Paper 




Figure 46. Arrangement of Segments in a 4-inch Printhead 

An 8-inch printhead can be constructed from two 4-inch printheads or from a single 8-inch 
printhead consisting of 16 segments. Regardless of the construction mechanism, the effec- 
tive printhead is stil! 8 inches in length. 

A 2-inch printhead has a similar arrangement, but only uses 4 segments. Likewise, a 
full-bleed A4/Lerter printer uses 1 7 segments for an effective SVi'^ printing area. 

Since the total number of nozzles in a segttient is 800C (see Table 10), the total number of 

nozzles in a given printhead with S segments is 800CS. Thus segment N is responsible for 
printing dots 800N to 800N+799. 

A number of considerations must be made when wiring up a printhead. As the width of the 
printhead increases, the number of segments increases, and the number of connections 
also increases. Each segment has its own ColorData connections (C of them), as well as 
SRCIock and other connections for loading and printing. 
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14.2.1 Loading Considerations 



When the number of segments 5 is small it is reasonable to load all the segments simulta- 
neously by usmg a common SRCIock line and placing C bits of data on each of the Color- 
Data .nputs for the segments. In a 4.inch printer, S=8, and therefore the total number of 
n nfl Tf^' to the pnnthead in a single SRCIock pulse is 32. However for an 8-inch 
pnn er, S-16, and it is unlikely to be reasonable to have 64 data lines running from the 
prmt data generator to the printhead. 

Instead, it is convenient to group a number of segments together for loading purposes 
Each group of segments is small enough to be loaded simultaneously, and share an 
SRCIock. For example, an 8-inch printhead can have 2 segment groups, each seomem 
group co,,ta,ning 8 segments. 32 ColorData lines can be shared fo^ both groups wkh 2 
^KUiock lines, one per segment group. 

Mien the number of segment groups is not easily divisible, it is still convenient to group 
the segments^ One example is a 8'/." printer for producing A4/Letter pages. There are 17 
segments and these can be grouped as two groups of 9 (9C bits of data going to each seg- 
ment, w.th all 9C b.ts used in the first group, and only 8C bits used for the second group) 
or as 3 groups of6 (again, C bits are unused in the last group). 

As the number of segment groups increases, the time taken to load the printhead increases 

hl.rw."'^ u ^ P"'^" ^^^"'"-^d (^^^h pulse transfers C data 

bits). When there are G groups, 800G load pulses are required. The bandwidth of the con- 
nection between the data generator and the printhead must be able to cope and be within 
the allowable timmg parameters for the particular application. 

If C- isthe number of segment groups, and L is the largest number of segments in a group 
he pnnthead requires LC ColorData lines and G SRCIock lines. Rega'diess of Q onlv a 
single PTransfer hne is required - it can be shared across all segments. 

Since L segments in each segment group are loaded with a single SRCIock pulse any 
pnntmg process must produce the data in the correct sequence for the printhead As an 
example, when G=2 and L=4, the first SRCIock 1 pulse will transfer the ColorData bits for 

the cl T' ? r "^^^ S'^C'-'^ P"'- transfer 

^pV?H 1 ' u '^^ ^^'^'""^ ^200, 4000, 4800. and 5600. The second 

iSm i ^^'nf r ''^"^f^'-^he ColorData bits. for the next Print Cycle's dot I,, 801 

PHn r , V- P"'^^ the ColorData bits for th; next 

Print Cycle's dot 3201, 4001, 4801 and 5601. 

i!ll\^^T/-^^^°u^ ""'l" '° each of SRCIock 1 and SRClock2). the entire line has 
been loaded into the printhead, and the common PTransfer pulse can be given. 

l!.VpH„Tr"' .'° T' "'^'^ '"'^ "'""^ °"'P"'^' ^'^'^°^gh printed during the 

f L J ^ • ^PP^^' °" '^'"^ P^y''"^^ °"tput line. The phvsicai separation 

of odd and even nozzles within the printhead, as well as separation between nozzles of dif- 
erent colors ensures. that they vyill produce dots on different lines of the page. This rela- 
tive difference must be accounted for when loading the data into the printhead. The actual 
difference in lines depends on the characteristics of the inkjet mechanism used in the print- 
head. The differences can be defined by variables D, and D, where D. is the distance 
between nozzles of different colors, and D, is the distance between nozzles of the same 
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color. Considering only a single segment group, Table 13 shows the dots transferred to 
segment of a printhead during the first 4 pulses of the shared SRCIock. 



Table 13. Order of Dots Transferred to a Segment in a Printhead 



Pulse 




: ;e ^^iSi^I?*- irSf'^s'- 

jgoIOMrlUnoL:! 


W4 


)rt Line :> 




1 


800S^ 


N 




N+D 


b 


N+(C-1)Di 




2 


800S+1 






N+D 


+D2 


N+(C-1)Di 


+D2 


3 


800S+2 


N 




N+D 




N+(C-1)Di 




4 


800S+3 


N+D2 




N+D 


+D2 


N+(C-1)D 


+D2 



a. S = segment number 

b. Di = number of lines between the nozzles of one color and the next (likely = 4-8) 

c. D2 = number of lines between two rows of nozzles of the same color (likely = 1 ) 



And so on for all 800 SRCIock pulses to the particular segment group. 

14.2.2 Printing Considerations 

With regards to printing, we print 4C nozzles from each segment in the low-speed printing 
mode, and 8C nozzles from each segment in the high speed printing mode. 

While it is certainly possible to wire up segments in any way, this document only consid- 
ers the situation where all segments ftre simultaneously. This is because the low-speed 
printing mode allows low-power printing for small printheads (e.g. 2-inch and 4-inch), 
and the controller chip design assumes there is sufficient power available for the large 

print sizes (such as 8-1 8 inches). It is a simple matter to alter the connections in the print- 
head to allow grouping of firing should a particular application require it. 

When all segments are fired at the same time 4CS nozzles are fired in the low-speed print- 
ing mode and 8CS nozzles are fired in the high-speed printing mode. Since all segments 
print simultaneously, the printing losic is the same as defmed in Section 14.1.2.2 on page 
58. 

The timing for the two printing modes is therefore: 

• 200 \is to print a line at low speed (comprised of 100 2|as cycles) 

♦ 1 00 |is to print a line at high speed (comprised of 50 2|is cycles) 

14.2.3 Feedback Considerations 

A segment produces several lines of feedback, as defined in Section 14.1.3 on page 61. 
The feedback lines are used to adjust the timing of the firing pulses. Since multiple seg- 
ments are collected together into a printhead, it is effective to share the feedback lines as a 
tri-state bus, with only one of the segments placing the feedback information on the feed- 
back lines at a time. 

Since the selection of which segment will place the feedback information on the shared 
Tsense, Vsense, Rsense, and Wsense lines uses the Colorl Data line, the groupings of seg- 
ments for loading data can be used for selecting the segment for feedback. 
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14.2.4 



Just as there are G SRCIock lines (a single line is shared between segments of th. c 

wi IZT^T . " " ^^S"^"' «f "^^^ 8™"P -hose Color] Data bk is se; 

t"^s of fledE I' r T 'I" '^^''^'^'^ "^^ -g--^ previously ac iveTn 

mrmlv be hT '° ''^ '^^"'"S ^ ° °" Colon Data bit, and th sel 

group cTane nVthl^";; 'T"' ""'^"^'"^^ '''^^ '^an one se^^e^t 

'n2Lt::rZ l^^^^^^^ ^^^"^^"^ -'•"'-^ -^P- ^^-b-ing the old segn,enf and 

Printhead Connection Summary 

Itdbed in ' P'*"^'''' constructed from a number of segments as 

described m the previous sections. It assumes that for data loadin- purposes the se-menN 

Pdntheari^^^^^^^^ V"" "^^""^^^ ^^^^ ^^^"^ mechanism for the 

Ebacf '^^^^^^ simultaneously, and only one segment at a time places 

hTextemlf " a common tr.-state bus. Assuming all these things. Table 14 lists 

the external connections that are available from a printhead: 

Table14. Printhead Connections 



Name 



Chrom apod Select 



NozzleSeiect 



PodgroupEnable 



AEnable 



BEnable 



ColorData 



#Pins 



SRCiock 



PTransfer 



SenseSegSeiect 



CL 



{^DeseHptloh 



Select which chromapod will fire (0-4) 



Select which nozzle from the pod will fire (0-9) 



Enable the podgroups to fire (choice of: 01, 10, 11) 



Firing pulse for phasegroup A 



Firing pulse for phasegroup B 



Tsense 



Vsense 



Rsense 



Wsense 



Logic GND 



Logic PWR 



V+ 

TOTAL 



Bus 
bars 



Inputs to C shift registers of segments 0 to L-1 



A pulse on SRCIock[N] (ShiftRegisterClock N) loads the current 
values rom ColorData lines into the L segments in segment 
group N. 3 a 



Parallel transfer of data from the shift registers to the internal 
NozzleEnable bits (one per nozzle). 



A pulse on SenseSegSeiect N ANDed with data on 

Colon Data[n] selects the sense lines for segment n in segment 

group N. . . . 



Temperature sense 



Voltage sense 



Resistivity sense 



Width sense 



Logic ground 



Logic power 



Actuator Ground 



Actuator Power 



18+2G+CL 
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15 Memjet Printhead Interface 

The printhead interface (PHI) is the means by which the processor loads the Memjet print- 
head with the dots to be printed, and controls the actual dot printing process. The PHI con- 
tains: 

• a LineSyncGen unit (LSGU), which provides synchronization signals for multiple 
chips (allows side-by-side printing and front/back printing) as well as stepper motors. 

• a Memjet interface (MJI), which transfers data to the Memjet printhead, and controls 
the nozzle firing sequences during a print. 

• a line loader/format unit (LLFU) which loads the dots for a given print line into local 
buffer storage and formats them into the order required for the Memjet printhead. 

The units within the PHI are controlled by a number of registers that are programmed by 
the processor. In addition, the processor is responsible for setting up the appropriate 
parameters in the DMA controller for the transfers from memory to the LLFU. This 
includes loading white (all O's) into appropriate colors during the start and end of a page 
so that the page has clean edges. 

The PHI is capable of dealing with a variety of printhead lengths and formats. In terms of 
broad operating customizations, the PHI is parameterized as follows: 



Table 15. Basic Printing Parameters 



Name , 




. ; Range V: 


MaxColors 


No of Colors in printhead 


1-4 


SegmentsPerXfer 


No of segments written to per transfer. Is equal to the 

number of segments in the largest segment group 


1-9 


SegmentGroups 


No of segment groups in printhead 


1-4 



The internal structure of the PHI allows for a maximum of 4 colors, 9 segments per trans- 
fer, and 4 transfers. Transferring 4 colors to 9 segments is 36 bits per transfer, and 4 trans- 
fers to 9 segments equates to a maximum printed line length of 18 inches. The total 
number of dots per line printed by an 1 8-inch 4 color printhead is 1 1 5,200 (18x1 600 x 4). 



Other -exam ple- settings are-shown in Table \ 6 : 



Table 16. Example Settings for Basic Printing Parameters 



Printer Length 


Printer Type 


MaxColors 


X 

,0 

. a. 
0 

CO 


SegmentGroups 


Bits pier Xfer .. 


Comments 


4 inch CMY 


Photo 


3 


8 


1 


24 




8 inch CMYK 


• A4/Letter 


4 


8 


2 


32 




8/2 inch CMYK 


A4/Letter full bleed 


4 


9 


2 


36 


Last xfer not fully used 


12 inch CMYK 


A4 long / A3 short 


4 


8 


3 


32 




16 inch CMYK 




4 


8 


4 


32 




17 inch CMYK 


A3 long full bleed 


4 


9 


4 


36 


Last xfer not fully used 


18 inch CMYK 




4 


9 


4 


36 
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15.1 



Block Diagram of Printhead Interface 

The internal structure of the Printhead Interface is shown in Figure 47. 
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Figure 47. Internal Structure of Printhead Interface 

contmlThl' m'' T f^""'- '''' '-^^^ P--^^"^" LineSyncO, which is used to 
Lin sic, .hT^^^ Interface in all synchronized chips. The second LSGU produces 
LmeSync i which is used to pulse the paper drive stepper motor. 

s^5e b^^df "'^'P "^""'■P'^ ^'^'P^ «° be connected together for 

V as;^XL 'T?''' ^ Master/Slave relationship. When the 

Master, Slave p,n ,s attached to Vod, the chip is considered to be the Master, and LineSync 

SvlTtf "'™'r LineSyncGen units are enabled onto the two tri-state Line- 

Sync connmon imes (LmeSyncO and LineSync I , shared by all the chips). When the Ma - 
ter Slave p,n .s attached to GND. the chip is considered to be the sfave. and L neSvnc 

s ' c iLr;: this ' 1,""'''".'°^" ""'^^ ^"^^'^^ — ^ 

connected clips P"'"^ "^^'^ ^" ^"'^ °" ^" ^^^^ 

MlfeUnTe^^^^^^^^ Loader/Fon.at Unit and 



15.2 LineSyncGen Unit 



r?c,ui'rerfor"nrin.i ^^SGU) are responsible for generating the synchronization pulses 
eqmred for printing a page. Each LSGU produces an e.xtemal LineSync signal to enable 

o d T-lo-ZTr '"^''^ ''^^^ ^ LineSyn^c pube ^he 

JulseTreoisteT n'' ^'"'^^"'^ P"'^" determined by the CyclesBetween- 

nOO us or 700 . h"""'"' '^"^^ '° "ne to print 

^It can be In^' "^P/"'^'"! °" ^'^^''^^^ '»^- ^P^^^ or high) and another line to load, 

but can be longer as desired (for example, to accommodate special requirements of paper 
transport circuitry). If the CyclesBetweenPulses register is se, to a num'ber lTss than aline 
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print time, the page will not print properly since each LineSync pulse will arrive before the 
particular line has finished printing. 

The following interface registers are contained in the LSGU: 



Table 17. LineSyncGen Unit Registers 







CyctesBetweenPulses 


The number of cycles to wait between generating one Line- 
Sync pulse and the next. 


Go 


Controls whether the LSGU is currently generating LineSync 
pulses or not. 

A write of ^ to this register generates a LineSync pulse, 
transfers CyclesBetweenPuIses to CyclesRennaining. and 
starts the countdown. When CyclesRennaining hits 0. another 
LineSync putse is generated. CyclesBetweenPuIses is trans- 
ferred to CyclesRennaining and the countdown is started 
again. 

A write of 0 to this register stops the countdown and no more 
LineSync pulses are generated. 


CyclesRennaining 


A status register containing the number of cycles remaining 
until the next LineSync pulse is generated. 



The LineSync pulse is not used directly from the LGSU. The LineSync pulse is enabled 
onto a tri-state LineSync line only if the Master/Slave pin is set to Master Consequently 
the LineSync pulse is only used in the form as generated by the Master chip (pulses gener- 
ated by Slave chips are ignored). 

15.3 Memjet Interface 

The Memjet interface (MJI) transfers data to the Mennjet printhead, and controls the noz- 
zle firing sequences during a print. 

The MJI is simply a State Machine (see Figure 48) which follows the printhead loading 
and firing order described in Section 14.2.1 on page 64, Section 14.2.2 on page 65, and 
includes the functionality of the Preheat Cycle and Cleaning Cycle as described in Section 
14. 1 .4 on page 61 and Section 14. 1 .5 on page 6 1 . Both high-speed and low-speed printing 
modies are available, although the MJI always fires a given nozzle fVohi ail seghients in a 
printhead simultaneously (there is no separate firing of nozzles from one segment and then 
others). Dot counts for each color are also kept by the MJI. 

The MJI loads data into the printhead from a choice of 2 data sources: 

• All Is. This means that all nozzles will fire during a subsequent Print cycle, and is the 
standard mechanism for loading the printhead for a preheat or cleaning cycle. 

• From the 36-bit input held in the Transfer register of the LLFU. This is the standard 
means of printing an image. The 36-bit value from the LLFU is directly sent to the 
printhead and a I -bit 'Advance' contror pulse is sent to the LLFU. 

The MJI knows how many lines it has to print for the page. When the MJI is told to *go\ it 
waits for a LineSync pulse before it starts the first line. Once it has finished loading/print- 
ing a line, it waits until the next LineSync pulse before starting the next line. The MJI 
stops once the specified number of lines has been loaded/printed, and ignores any further 
LineSync pulses. 
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mHI' therefore directly connected to the LLFU, LineSyncO (shared between all syn 
chromzed ch.ps), and the external Memjet printhead. The basic structure is shown in Fig-" 



LineSyncO 




Figure 48. Memjet Interface 
m to the nutnber of segments and number of colors will be valid. For example if there 

Tes n^t "are wh^h Kr ^^^.f S'-/"' I, bits 6-7 will be invalid etc. The state machine 
aoes not care which bits are valid and which bits are not valid - it merely passes the hit. 

o°; iL'erioTh'- '"^ ^'^"^'^ '^^-'"^ ofTel^Cn b wi 

rZe ofl Ju . ^T"'' "^'P' "''"S as few pins as required by the application 

range of the ch.p (see Section 1 5.3. 1 oh page 70 for more information). 



15.3.1 Connections to Printhead 



clocked in to ' °f connections to the printhead, including a maximum of 4 colors 

The te . ""'/""T °f 9 transfer to a maximum of 4 segment groups' 

alMines w H"' T '^j' P'"^ °" ^he chip^ although not 

nectin to 8 inch CM YK printers, only 32 bits of data need to be transferred each transfer 

the same wS":: -f/Rr: T''. '^°'°^>' -^--^ ^ 

me same wav, only 2 SRCiock pulses are required, so onlv 2 pins instead of 4 oins are 

required to cater for the different SRClocks. And so on. ' 

necJed'to n.-r'' '^°"^P'f ^'^ S^"^---- then all connections from the ,V1JI must be con- 
nected to pms on the chip (and thence to the Memjet printhead). 

nec/il't! "maximum connections from the .MJl„many of which.are always con- 

the nu' 'be'rof"" "^"^ ''^ """"^^ foo^no^e explabs X 

1 ne names correspond to the pm connections on the printhead. 

Table 18. Memjet Interface Connections 



Name 


#Pins 


I/O 


Description 


Chromapod Select 


3 


o 


Select which chromapod will fire (0-4) 


NozzleSelect 


4 


o 


Select which nozzle from the pod will fire (0-9) 


Pod^roupEnable 


- 2 


o 


Enable the podgroups to fire ^choice of; 01. 10 11) 


AEnable 


1 


o 


Firrng pulse for podgroup A. In the current design all 
segments fire simultaneously, although multiple AEnable 
lines could be added for dividing the firing sequence 
over multiple segment groups for reasons of power and 
speed. 
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Table 18, Memjet Interface Connections 











BEnable 




O 


Firing pulse for podgroup B. In the current design all 
segments fire simultaneously, although multiple BEnable 
tines could be added for dividing the firing sequence 
over multiple segment groups for reasons of pow/er and 
speed. 


Colon Data[0-8] 


9^ 


O 


Output to Colon Data shift register of segments 0-8 


Color2Data[0-8] 


gb 


o 


Output to CoIor2Data shift register of segments 0-8 


Color3Data[0-8] 


9^ 


o 


Output to ColorSData shift register of segments 0-8 


Color4Data[0-8] 


9^ 


o 


Output to Color4Data shift register of segments 0-8 


SRCIock[1-4] 


4® 


o 


A pulse on SRCIock[N] (ShiftRegisterClock) loads the 
current values from ColorlData[0-8]. Color2Data[0-8], 
Color3Data[0-8] and Color4Data[0-8] into the segment 
group N on the printhead. 


PTransfer 


1 


o 


Parallel transfer of data from the shift registers to the 
printhead's internal NozzleEnable bits (one per nozzle). 


SenseSegSelect[1-4] 


4^ 


o 


A pulse on SenseSegSelect[N] ANDed with data on 
Color1Data[n] enables the sense lines for segment n in 
segment group N of the printhead. 


Tsense 


1 


t 


Temperature sense 


Vsense 


1 


1 


Voltage sense 


Rsense 


1 


1 


Resistivity sense 


Wsense 


1 


1 


Width sense 


TOTAL 


52 







a. Although 9 lines are available from the MJl. the number of pins coming from the chip will only 
reflect the actual number of segments in a segment group. The pins for Colon Data are man- 
datory, since each printhead must print in at least 1 color 

b. These lines are only translated into pins if the chip is to control a printhead with at least 2 col- 
ors. Although 9 lines are available from the MJl. the number of pins coming from the chip for 
Color2Data will only reflect the actual number of segments in a segment group. 

c. These lines are only translated into. pins if the chip is to control a printhead with at least 3 col- 
ors. Although 9 lines are available from the MJI, the number of pins coming from the chip for 
Color3Data will only reflect the actual number of segments in a segment group. 

d. These lines are only translated into pins if the chip is to control a printhead with 4 colors. 
Although 9 lines are available from the MJI. the number of pins coming from the chip for 
Color4Data will only reflect the actual number of segments in a segment group. 

e. Although 4 lines are available from the MJI, the number of pins coming from the chip will only 
reflect the actual number of segment groups, A minimum' of 1 pin is required since there is at 
least 1 segment group (the entire printhead). 

f. Although 4 lines are available from the MJI, the number of pins coming from the chip will only 
reflect the actual number of segment groups. A minimum of 1 pin is required since there is at 
least 1 segment group (the entire printhead). 



15.3.2 Firing Pulse Duration 

The duration of firing pulses on the AEnable and BEnable lines depend on the viscosity of 
the ink (which is dependant on temperature and ink characteristics) and the amount of 
power available to the printhead. The typical pulse duration range is 1 .3 to 1 .8 ^s. The MJI 
therefore contains a programmable pulse duration table, indexed by feedback from the 
printhead. The table of pulse durations allows the use of a lower cost power supply, and 
aids in maintaining more accurate drop ejection. 

The Pulse Duration table has 256 entries, and is indexed by the current Vsense and Tsense 
settings. The upper 4-bits of address come from Vsense, and the lower 4-bits of address 
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oTus Tr '""^ l^'''' '"^ ^^P^"^"'^ ^ f^'^^'^ P°'"' -^'"^ the range of 

0-4^s. The process of generating the AEnable and BEnable hnes is shown in Figure 49. 



Vsense 



Tsense 




L AEnable 
^ BEnable 



4-bit ADC 
(non-linear) 



Figure 49. Generation of AEnable and BEnable Pulse Widths 

InLf^'^T ^^^""'^ P^^"^i"S first page. The table may be 

updated in between pages if desired. Each 8-bit pulse duration entry in the table combines! 

• User brightness settings (from the page description) 

• Viscosity curve of ink (from the QA Chip) 

• Rsense 

• Wsense 

• Vsense 

• Tsense 



15.3.3 Dot Counts 



^he cou ; r ^^^^^^ «f -ach cdor fired from the printhead. 

tr^l A 3° h K T ' : ' -ndividually cleared under processor con- 

8 incl^L ! -> ^'"^ ' °' ^"^'^ " <r^ax>mun, coverage dot count of 17 

after each 0^0" 'kT/' '^P'"' ''^ cleared 

arter each page or half-page. 

t^he'i nt car.' "'"'^ by the processor to update the QA chip in order ,0 predict when 

for eih of the> rT u ' "o/'T- P™'^"'^'' ^^'"'"^ °f i" »he canridge 

fo inktn. T fro"i.the QA ch.p,Counting the number of drops eliminates the ne^d 

enouah nk lef? H n ''k'''' P'^'" ^ ^^^^ ''^ P""'^^ unless there is 

pa"e which 1 . H " H '"'"^^ '""^ - ''"d half-printed 

page Which must be reprinted. 
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The layout of the dot counter for Color! is shown in Figure 50. The remaining 3 dot 
counters (Colorl DotCount, Coior2DotCount, and Color3DotCount) are identical in struc- 
ture. 



ColorlData . 



9 


9 line to 4 

line 
encoder 


— A — ^ 


► 






32 
—A- 



SRClock[l-4] 



ClearCount 
I f Clea r 



32-bit Colorl DotCount 



32 



32 



Figure 50. Dot Count Logic 



15.3.4 Registers 



The processor communicates with the MJI via a register set. The registers allow the pro- 
cessor to parameterize a print as well as receive feedback about print progress. 



The following registers are contained in the MJI: 



Table 19. Memjet Interface Registers 



Register Name 




Print Parameters 


SegmentsPerXfer 


The number of segments to write to each transfer. This also equals 
the number of cycles to wait between each transfer (before generating 
the next Advance pulse). Each transfer has MaxColors x Seg- 
mentsPerXfer valid bits. 


SegmentGroups 


The number of segment groups in the printhead. This equals the num- 
ber of times that SegmentsPerXfer cycles must elapse before a single 
dot has been written to each segment of the printhead. The MJI does 
this 800 times to completely transfer all the data for the line to the 
printhead. 


PrintSpeed 


Whether to print at low or high speed (determines the value on the 
PodgroupEnable lines during the print). 


NunnLines 


The number of Load/Print cycles to perform. 


Monitoring the Print (read only fronn point of view of processor) 


Status ■ ■ ^ ■ ■■ ' ; 


The Memjetlnterface's Status Register 


LInesRemaining 


the number of lines remaining to be printed. Only valid while Go=1. 
Starting value is NumLines and counts down to 0. 


TransfersRemaining 


The number of sets of SegmentGroups transfers remaining before the 
Printhead is considered loaded for the current line. Starts at 800 and 
counts down to 0. Only valid while Go=1. 


SegGroupsRemaining 


The number of segment groups remaining in the current set of trans- 
fers of 1 dot to each segment. Starts at SegmentGroups and counts 
down to 0. Only valid while Go=1. 


SenseSegment 


The 9-bit value to place on the ColorlData lines during a subsequent 
feedback SenseSegSelect pulse. Only 1 of the 9 bits should be set. 
corresponding to one of the (maximum) 9 segments. See SenseSe- 
lect for how to determine which of the segment groups to sense. 
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Table 19. Memjet Interface Registers 







SetAIINozzIes 


If non-zero, the 36-bit value written to the printhead during the Load- 
Dots process is all 1s. so that all nozzles will be fired during the subse- 
quent PnntDots process. This is used during the preheat and cleaninq 
cycles. ^ 

If 0, the 36-bit value written to the printhead comes from the LLFU 
This IS the case during the actual printinq of reoular imaqp?; 


Actions — 


Keset 


A wrrte to this register resets the MJI. stops any loading or printing 
processes, and loads all registers with 0. 


SenseSelect 


A write to this register with any value clears the FeedbackValid bit of 
the Status register, and the remaining action depends on the values in 
the LoadingDots and PrintingDots status bits. 

If either of the status bits are set. the Feedback bit is cleared and noth- 
ing more is done. 

If both status bits ar** rlf»ar a milcA ic« nU.A^ ■ * 

^laiua una <aic (^redr, a puise IS given Simultaneously on all 4 
SenseSegSelect lines with all ColorOata bits 0. This stops any exist- 
ing feedback. Depending on the two low-order bits written to Sense- 
Select register, a pulse is given on SenseSegSelectI , 
SenseSegSelect2, SenseSegSelect3, or SenseSegSelect4 line, with 
the Colon Data bits set according to the SenseSegment register. 
Once the various sense lines have been tested, the values are placed 
in the Tsense. Vsense. Rsense. and Wsense registers, and the Feed- 
back bit of the Status register is set. 


Go 


A write of 1 to this bit starts the LoadDots / PrintDots cycles which 
commences with a wait for the first LineSync pulse. A total of Num- 
Lines lines are printed, each line being loaded/printed after the receipt 
of a LtneSync pulse. The loading of each line consists of Segment- 
Groups 36-bit transfers. As each line is printed, LinesRemaining dec- 
rements, and TransfersRernaining is reloaded with SegmentGroups 
again. The status register contains print status information Upon com- 
pletion of NumLines, the loading/printing process stops, the Go bit is 
cleared, and any further LineSync pulses are ignored. During the final 
print cycle, nothing is loaded into the printhead. 

A write of 0 to this bit stops the print process, but does not clear any 
other registers. 


ClearCounts 



A write to this register clears the Colon DotCount. Color2DotCount 
Color3DotCount, and Co!or4DotCount registers if bits 0, 1 2 or 3 
respectively are set. Consequently a write of 0 has no eWrt ' 


Feedback — ■ 


isense 


Read only feedback of Tsense from the last SenseSegSelect pulse 
sent to segment SenseSegment. Is only valid if the FeedbackValid bit 
of the Status register is set. 


Vsense 


Read only feedback of Vsense from the last SenseSegSelect pulse 
sent to segment SenseSegment. Is only valid if the FeedbackValid bit 
of the Status register is set. 


Rsense 


Read only feedback of Rsense from the last SenseSegSelect pulse 
sent to segment SenseSegment. Is only valid if the FeedbackValid bit 
of the Status register is set. 


Wsense 


Read only feedback of Wsense from the last SenseSegSelect pulse 
sent to segment SenseSegment. Is only valid if the FeedbackValid bit " * 
of the Status register is set. 


ColorlDotCount 


Read only 32-bit count of colon dots sent to the pnnthead 


Color2DotCount 


Read only 32-bit count of color2 dots sent to the printhead 
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Table 19. Memjet Interface Registers 







Color3DotCount 


Read only 32-bit count of color3 dots sent to the printhead 


CoIor4DotCount 


Read only 32-bit count of color4 dots sent to the printhead 



The MJTs Status Register is a 16-bit register with bit interpretations as follows: 



Table 20. MJI Status Register 





Bits V 




LoadingDots 


1 


If set, the MJI is currently loading dots, with the number of dots 
remaining to be transferred in TransfersRemaining. 

if clear, the MJI is not currently loading dots 


PrintingDots 


1 


If set, the MJI is currently printing dots. 

If clear, the MJI is not currently printing dots. 


PrintingA 


1 


This bit is set while there is a pulse on the AEnable line 


Printings 


1 


This bit is set while there is a pulse on the BEnable line 


FeedbackVatid 


1 


This bit is set while the feedback values Tsense, Vsense, 
Rsense, and Wsense are valid. 


Reserved 


3 




PrintingChromapod 


4 


This holds the current chromapod being fired while the 
PrintingDots status bit is set. 


PrintingNozzIes 


4 


This holds the current nozzle being fired while the 
PrintingDots status bit is set. 



The following pseudocode illustrates the logic required to load a printhead for a single 
line. Note that loading commences only after the LineSync pulse arrives. This is to ensure 
the data for the line has been prepared by the LLFU and is valid for the first transfer to the 
printhead. 



Wait for LineSync 

For TransfersRemaining = 800 to 0 
For I = 0 to Segmen tGroups 
If (SetAllNozzles) 

Set all ColorData lines to be 1 
Else 

Place 35 bit input on 35 ColorData lines 
Endl f 

Pulse SRClock[Il 
Wait Segn:ientsPer:<f er cycles 
Send ADVANCE signal 
EndFor 
EndFor 
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15.3.5 Preheat and Cleaning Cycles 



i!i^the MJl'"^ ''""^^^ accomplished by setting appropriate registers 



• SetAIINozzles = 1 

• Set the PulseDuratlon register to either a low duration (in the case of the preheat mode) 
or to an appropriate drop ejection duration for cleaning mode. 

• Set NumLines to be the number of times the nozzles should be fired 

• Set the Go bit and then wait for the Go bit to be cleared when the print cycles have 
completed. 

The LSGU must also be programmed to send LineSync pulses at the correct frequency. 



15.4 Line Loader/Format Unit 



The line loader/format unit (LLFU) loads the dots for a given print line into local buffer 
storage and formats them into the order required for the Memjet printhead. It is responsi- 
ble tor supplying the pre-calculated nozzleEnable bits to the Memjet interface for the 
eventual printing of the page. 

The printing uses a double buffering scheme for preparing and accessing the dot-bit infor- 
mation. While one line is being loaded into the first buffer, the pre-loaded line in the sec- 
ond buffer IS being read in Memjet dot order. Once the entire line has been transferred 
from the second buffer to the printhead via the Memjet interface, the reading and writino 
processes swap buffers. The first buffer is now read and the second buffer is loaded up 
wi h the new line of data. This is repeated throughout the printing process, as can be seen 
m the conceptusi overview of Figure 51.. 



32 



Buffer 0 



Buffer 1 




36 



To 
Memjet 
Interface 



Z3 

Q 







4 




Buffer 0 




IZ 







32 



Format 


■36 




Dots 




-► 



Buffer 1 



■ To 
Memjet 
Interface 



Figure 51. Conceptual Overview of Double Buffering 
During Print Lines N and N+1 

The size of each buffer is 14KBytes to cater for the maximum line length of 18 inches in 4 
colors ( 8 X 1600 X 4 bits - 1 1 5,200 bits = 14,400 bytes). The size for both Buffer 0 and 
tsurter 1 is 28.128 KBytes. While this design allows for a maximum print length of 18 
inches. It IS trivial to reduce the buffer size to target a specific application 
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The actual implementation of the LLFU is shown in Figure 52. Since one buffer is being 
read from while the other is being written to, two sets of address lines must be used. The 
32-bits Datain from the common data bus are loaded depending on the WriteEnabtes, 
which are generated by the State Machine in response to the DMA Acknowledges. 



To DMA Controller 



Common 
DataBus 



^-32 
Data In 



Requests 
4 



Buffer 0 



WriteEnables 

i 



Acknowledges 

WriteEnables 



13 



Address 



State 
Machine 



13 



Address 



9 entry x 4-bit shift register 



36 



y22 

Datain 



Buffer 1 



^4 



Advance 



From 
MJi 



36-bit Transfer register 



36 To 
-/^ ► MJI 



Figure 52. Structure of LLFU 

A multiplexor chooses between the two 4-bit outputs of Buffer 0 and Buffer 1 , and sends 

the result to a 9-entry by 4-bit shift register After a maximum of 9 read cycles (the number 
depends on the number of segments written to per transfer), and whenever an Advance 
pulse comes from the MJI, the current 36-bit value from the shift register is gated into the 
36-bit Transfer register, where it can be used by the MJI. 

Note that not all the 36 bits are necessarily valid. The number of valid bits of 36 depends 
on the number of colors in the printhead, the number of segments, and the breakup of seg- 
ment groups (if more than one segment group). For more information, see Section 14.2 on 
page 63. . . . . , . . , 

A single line in an L-inch C-co!or printhead consists of I600L C-color dots. At I bit per 
colored dot, a single print-line consists of 1 600 LC bits. The LLFU is capable of address- 
ing a maximum line size of 18 inches in 4 colors, which equates to 108,800 bits (14 
KBytes) per line. These bits must be supplied to the MJI in the correct order for being sent 
on to the printhead. See Section 14.2.1 on page 64 for more information concerning the 
Load Cycle dot loading order, but in summary, 2LC bits are transferred to the printhead in 
SegmentGroups transfers, with a maximum of 36 bits per transfer Each transfer to a par- 
ticular segment of the printhead must load all colors simultaneously. 
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15.4.1 Buffers 



Each of the two buffers is broken into 4 sub-buffers, I per color. The size of each 
sub-buffer ,s ^600 bytes, enough to hold 18-inches of single color dots at 1600 dpi The 

m K> Tf^'"'"^ ^ ''"^^^ '^^'^ addresses for each buffer (requiring 

lu Dits or address). ^ 



All the even dots are placed before the odd dots in each color's buffer, as shown in Figure 
It there is any unused space it is placed at the end of each color's buffer. 



Buffer 0/1 



Colorl Dots Buffer 



Color2 Dots Buffer 



CoIor3 Dots Buffer 



Color4 Dots Buffer 



Even Dots 



Odd Dots [ip 



Figure 53. Conceptual Structure of Buffer 

hiV-'^Tr ''^^''^'ry ^^^"^"y "s^d is directly related to the printhead length. If the print- 
head is 18 inches, there are 1800 bytes of even dots followed by 1800 bytes of odd dots 

Wd"L" 1 7nn "^r. '^^^^ is i2 inches, there are 1200 bytes of even dots foN 

lowed by 1200 odd dots, and 1200 bytes unused. 

The ^..^6^^^^ gai^f^jly ^3^^ ^i^^^^jy ^^^^^^ ^^^^j^^^ 

prmthead. This number is typically 3 or 4, although it is quite feasible for this system to be 
used m a 1 or 2 color system (with some small memoiy wastage). In a desktop printin- 

Srs-vln' r:'." f ^^^^^ ^^^^^ Colon^Cyan, CoIor24fagenta: 

Colori-Yellow, CoJor4=Black. 

The addressing decoding circuitry is such that in a given cycle, a single 32-bit access can 
hfrTf 1' i "* '"^-^"^f^^^ - ^'^her a read from all 4 or a write to one of the 4. Only one 
bit of the o2-bits read from each color buffer is selected, for a total of 4 output bits The 
process is shown in Figure 54. 15 bits of address allow the reading of a particular bit by 

froTrh c ^"'"^ "'"^ '° '"'^^ ^"'^ 5-bits of address choose 1-bit 

from those .2. Since all color buffers share this logic, a single I 5-bit address gives a total 
of 4 bits out. one per color. Each buffer has its own WriteEnable line, to allow a sino|e 
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32-bit value to be written to a particular color buffer in a given cycle. The 32-biis of 
Dataln are shared, since only one buffer will actually clock the data in. 

Address 15 5 



Write Colon 



10 



Dataln 32 




Write Color? 



Write Color3 



Write Color4 



Colorl Dots Buffer 



Color2 Dots Buffer 



Color3 Dots Buffer 



Color4 Dots Buffer 



32 

^ ► 



32 



32 



32 



^ 1 



7^ 



Figure 54. Logical Structure of Buffer 

Note that regardless of the number of colors in the printhead, 4 bits are produced in a 
given read cycle (one bit from each color's buffer). 



15-4.2 Address Generation 



15.4.2.1 Reading 

Address Generation for reading is straightforward. Each cycle we generate a bit address 
which is used to fetch 4 bits representing 1-bit per color for a particular segment. By add- 
ing 400 to the current bit address, we advance to the next segment's equivalent dot. We 
add 400 (not 800) since the odd and even dots are separated in the buffer. We do this firstly 
SegmentGroups sets of SegmentsPerXfer times to retrieve the data representing the even 
dots (the dot data is transferred to the MJI 36 bits at a time) and another SegmentGroups 
sets of SegmentsPerXfer times to load the odd dots. This entire process is repeated 400 
times, incrementing the start address each time. Thus all dot values are transferred in the 
order required by the printhead in 400 x 2 x SegmentGroups x SegmentsPerXfer cycles. 

In addition, we generate the TransferWriteEnabie control signal. Since the LLFU starts 
before the MJI, we must transfer the first value before the Advance pulse from the MJl. 
We must also generate the next value in readiness for the first Advance pulse. The solution 
is to transfer the first value to the Transfer register after SegmentsPerXfer cycles, and then 
to. stall SegmentsPerXfer-cyeles later, waiting for the Advance pulse to start the next Seg- 
mentsPerXfer cycle group. Once the first Advance pulse arrives, the LLFU is synchronized . 
to the MJL However, the LineSync pulse to start the next line must arrive at the MJl at 
least 2SegmenlsPerXfer cycles after the LLFU so that the initial Transfer value is valid and 
the next 32-bil value is ready to be loaded into the Transfer register. 

The read process is shown in the following pseudocode: 
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DoaeFirst = FALSE 

For DotlnSegmentO = 0 to 400 

CurrAdr = DotlnSegmentO 

XfersRemaining - 2 x SegmentGroups 

DotCount = SegmentsPerXf er 

Do 

VI = DotCount = 0 

TransferWriteEnable = (VI AND NOT DoneFirst) OR ADVANCE 
Stall = VI AND (NOT TransferWriteEnable) 
If (NOT Stall) 

Shift Register=Fetch 4-bits from CurrReadBuff er : CurrAdr 
CurrAdr = CurrAdr + 400 
If (VI) 

DotCount = SegmentsPerXf er - 1 
XfersRemaining = XfersRemaining - 1 
Else 

DotCount = DotCount - 1 
Endlf 
Endlf 

Until (XfersRemaining=0) AND (NOT Stall) 
EndFor 



The final transfer may not be fully utilized. This occurs when the number of segments per 
transfer does not divide evenly into the actual number of segments in the printhead An 
example of this is the 8/." printhead, which- has 17 segments. Transferring 9 segments 
each time means that only 8 of the last 9 segments will be valid. Nonetheless, the timing 
requires the entire 9th segment value to be generated (even though it is not used) The 
actual address is therefore a don't care state since the data is not used. 

Once the line has finished, the CurrReadBuffer value must be toggled by the processor, 
15.4.2.2 Writing 

The write process is also straightforward. 4 DMA request lines are output to the DMA 
controller As requests are satisfied by the return DMA Acknowledge lines, the appropri- 
ate 8-bit destination address is selected (the lower 5 bits of the 15-bit output address are 
don t care values) and the acknowledge signal is passed to the correct buffer's WriteEnable 
control line (the Current Write Buffer is -CurrentReadBuffer). The 10-bit destination 
address is selected from the 4 current addresses, one address per color. As DMA requests 
are satisfied the appropriate destination address is incremented, and the corresponding 
TransfersRemaming counter is decremented. The DMA request line is only set when the 
number of transfers remaining for that color is non-zero. 



The following pseudocode illustrates the Write 



process; 



CurrentAdr [ 1-4 1 = o 

While- (ColorXfersRemaining[l-4] are .non^zero) 

D^!.:\?,equest(l-4) = ColorXf ersRemaining [ 1-4 ) NOT = 0 
If DMAA>;,aowledge!N| 

CurcWcite3uffer:CurrentAcir(N) = Fetch 32-bits from data bus 

CurrentAdr[N| = CurrentAdr ( N] + i 

Endlf'"'''^^^'^^^"'''''''"^"'" ' ColorXfersRemainingtMJ - l (floor 0) 

EndWhi ie 
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15.4.3 Registers 

The following interface registers are contained in the LLFU: 



Table 21. Line Load/Format Unit Registers 







SegmentsPerXfer 


The number of segments whose dots must be loaded before 
each transfer. This has a maximum value of 9. 


SegmentGroups 


The number of segment groups in the printhead. This has a 
maximum number of 4. 


CurrentReadBuffer 


The current buffer being read from. When BufferO is being 

read from, Bufferl is written to and vice versa. 

Should be toggled with each AdvanceLine putse from the 

MJI. 


(jO 


Bits 0 and 1 control the starting of the read and write pro- 
cesses respectively. 

A non-zero write to the appropriate bit starts the process. 


Stop 


Bits 0 and 1 control the stopping of the read and write pro- 
cesses respectively. 

A non-zero write to the appropriate bit stops the process. 


stall 


This read-only status bit comes from the LLFU's Stall flag. 
The Stall bit is valid when the write Go bit is set. 
A Stall value of 1 means that the LLFU is waiting for the 
ADVANCE pulse from the MJI to continue. The CPU can 
safely start the LSGU for the first line once the Stall bit is set. 


ColorXfersRemaining[1-4] 


The number of 32-bit transfers remaining to be read into the 
specific Color[N] buffer. 



15.5 Controlling a Print 

When controlling a print the CPU programs and starts the LLFU in read mode to ensure 
that the first line of the page is transferred to the buffer. When the interrupts arrive from 
the DMA controller, the CPU can switch LLFU buffers, and program the MJL The CPU 
then starts the LLFU in read/write mode and starts the MJL The CPU should then wait a 
sufficient period of time to ensure that other connected printer controllers have also started 
their LLFUs and MJls (if there are no other connected printer controllers, the CPU must 
wait until the Stall bit of the LLFU is set, a duration of 2SegmentsPerXfer cycles). The CPU 
can then program the LGSU to start the synchronized print. As interrupts arrive from the 
DMA controllers, the CPU can reprogram the DMA channels, swap LLFU buffers, and 
restart the LLFU in read/write mode. Once the LLFU has effectively filled its pipeline, it 
will stall until the next Advance pulse from the MJI. The MJI does not have to be touched 
during the print. 

If for some reason the CPU wants to make any changes to the MJI or LLFU registers dur- 
ing an inter-line period it should ensure that the current line has finished printing/loading 
by polling the status bits of the MJI and the Go bits of the LLFU. 
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1 Pen Controller Architecture 

s?nso??„T P™^"^^'-' ^ transceiver, a tilt 



LEDs. 

autofocus 




Figure 1. Pen controller architecture 

^mLrr"""'""^ processor captures and decodes IR position tags from the page via the 
con Jnl T'' """"^'"Z" ^"^ P'"""^^ -"tofocus voice-coil. 

Lcal >^ttn ' ^p' ^ (tricolor LED), and handles wireless communication with the 

local Netpage Printer. It consists of a medium-performance (~25MHz RISC) general-pur- 
pose microprocessor. *^ 

Two-axis tilt sensing is provided by a two-axis accelerometer. Nib pressure sensing is pro- 
the spiSig'nib ^""^ P'^^'^diod- P^i^ conjunction with a reflector coupfed whh 

II'2\R°nRrM*^'''^' transceiver components, 96x96 image sensor, flash memoiy and 
acce^emmel^ ''hTIo ' • " '/L"^'" ^^'^^ ^^^^ ^"'^ components, 
Sd trSetpS :.';:;,;^,^'^'"^^^P'^°-^'°^^ '-^^-^^ - a smgle MEMS ch'ip. also 

JordlefJ teLT'"'""'' "'""""r^'" unlicensed 900MHz band nonnally used by 

frrlr^ ^"'^ frequency hopping and collision detection to provide inter- 

terence-free communication. 
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Netpage Encoding 
AND Decoding 
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2 Netpage Encoding 



Hidden .nformafon on a printed Netpage encodes the unique id of the page instance 
together w.th position .nfonnation which tells the pen whic^ part of the pa^e the usTr fs 
mteracting w,th. The Netpage Network can correlate any reference to any pa^of anrpaJe 
ever pnnted with the contents of the page, solely on the basis of the page id and "e p'ofi 



for sinl ^? . , K ^°"'T ^""'^ must be independent, to allow 

for smgle-po.nt virtual button and hyperlink presses, and so contains both the local x-y 

such n ! P"^' P^'''*^"'^^ with each tag 

such as whether the pen should turn on its light while over the tag. 

ToJTJ^^^^ ^- '""J."'^ ^"'^ ^^S^> error-correctably encoded 

dot itsei?ccS;?c7 T''"" ""^"5 """''^ '"^y '"-"odots. Each macro- 

dot Itself consists of a square of one or more printed dots to ease image processing. 

Jv.1h?!?" '"PP^"' ^ P^'""'"'^' P^g" '^^'■e the physical page size 

each w t r^^^ r ^ P^y^"=^' P^S« ^-P'y ^"-'1 vv'th multiple virtuafpages 

tags. The contents of each tag are not shown on this illustration. 



■ Single Tag 



Figure 2. Part of a page tiled with position tags 
The tags are printed with an infrared-absorptive ink that can be read by the pen device 
ll7:s uS bf k ' W ''"r'^'- 'T'^' ''^ provided on :f?set-prird 

tons ^Alternatively an invisible infrared ink can be used to print the position tags over the 

Z l:2:^ZT. T''''' '"T'"^ taken to ensure 

forblack ink .nformation on the page is printed in infrared-/ra«5par.«/ CMY ink. 

mlximt H ' '^2'- '^^ -monochromatic scheme was chosen to 

maximize dynamic range in blurry reading environments. 

fbl7coded"^f ' eT "T" """'^ specifically require invisible ink. Buttons could be vis- 
no other rt " "yP«^""'^s require invisible ink. but impose 
no other requirements on the tag encoding. ^ 
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Table 1. Encoding parameters 



; J parameter 






P 


virtual page width (inches) 




d 


dot pitch (dots per inch) 


1600 


k 


macrodot width (dots) 


4 


b 


registration border width (macrodots) 


2 


r 


data redundancy factor 


1.5 


m 


coordinate precision (bits) 




g 


page id precision (bits) 




s 


tag width (macrodots) 




n 


tags per page** 





a. US Letter page length 

b. per dimension 



Given the encoding parameters defined in Table 1, the tag width is given by: 
5 = + Jr{2m + g) 

Given a particular tag width, the number of tags per page in each dimension is given by: 



This in turn yields the required coordinate precision: 
m = log2Ai 

If 10 billion people all generate 100,000 pages per annum for 1000 years, they will gener- 
ate lO'^ pages, or approximately 2^^ pages. A page id precision of 64 bits should therefore 
be sufficient, notwithstanding issues of efficient contiguous page id allocation. 

Assuming a page id precision of 64 bits, and other parameter values as given in Table 1, 
the equations converge on a tag width of 17 macrodots, 283 tags per page dimension, and 
a coordinate precision of 9 bits. This precision supports a maximum page dimension of 
21.7" or 552mm. 

Given a particular tag width, the position resolution, in millimeters, is given by: 

25Aks 
d 

and, in points, is given by: 

72^5 
d 

This yields a position resolution of 3 points (1.08mm at 1600 dpi). 
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Magazine-quality printed text normally has a size of 10 points. Forms filled in bv h.„H 
nonr,a ly allow for handwritten text with a size of about 20%ints. AToition resolution of 
3 points therefore translates to a chatBcter-oriented resolu^on of 3.3 for pnnTed tera"! 
6.6 for handwntmg recognition. This position resolution is increased to the 200 

zr.Sd?~ '"'^ PosirortheL^^^^^^^^^^^^ 

With a position tag width of 1 7 macrodots, and 4x4 dots (at 1600 dpi) per macrodot the 
raw posmon tag gives about 24 positions per inch. Consequently anrposi ionr^lh 
must achieve 10 times better resolution based on tag position wit'hinThrsensed'm^ge 

2.1 Position Tag Structure 

Each position tag encodes the following information: 
Table 2. Data Encoded in a Position Tag 



' .-Name ''<"^' 


#Bits' 


Description • '^':?-^^'0M§^ 


Pageld 


64 


Defines the Netpage page instance id 


X 


9 


Defines the x coordinate within the given Pageld 


y 


9 


Defines the y coordinate within the given Pageld 


ActiveArea 


1 


Defines whether the pen should turn its light on while over 
the tag 


PressureSensitiveArea 


1 


Determtnes whether the pen should return continuous 
pressure or not while over the tag. 

0 = don't return pressure readings. 

1 = return pressure readings 


Reserved 


6 


For future use. Store as 0 for this version 


TOTAL 


90 





of ^600°H^-°H I'^ V^'"^.^'™^ ^'''^ ^^^h macrodot being a 4x4 square 

or 1600 dpi dots, as shown Figure 3. ^huuic 




Figure 3. IMacrodots in a Position Tag 

llT^^^ S.'' f'^ '"0"o<=hrome IR-absorptive dots, printed on an IR-reflective back- 
M usTft'e! f physically different from a "white macrodot" Hgure 4 

Illustrates a magnified view of macrodots. ^'gu'c h 
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Black and Black macrodot 

white macrodots surrounded by white 

Figure 4. Magnified Macrodots 

The position tag structure is based on concepts used in the public-domain Aztec 2D Bar- 
code [7], invented by Andy Longacre of Welch Allyn Inc. in 1995. While the position tag 
uses the same bulTs-eye structure mechanism from the Small Aztec Symbol for symbol 
location and orientation, we define our own interpretation for the mode bits and do not 
allow variable length structures. In addition, the position tag is a 17x1 7 array, which is not 
possible in a pure Aztec code. 




White macrodot 
surrounded by black 



Figure 5 shows the high-level structure of a position tag in relation to its 17x17 macrodot 
array. The target/orientation area consists of a 5-layer bulPs-eye with 3-bit orientation 
markers on the outer comers. The format of this area is identical to that used in the Small 
Aztec Barcode although it is placed off-center. The Mode Data Area is the area between 
the orientation markers in what would otherwise be the 6th layer of the bulPs-eye target. 
The remaining area is used to hold the actual data for the position tag. 




Legend 

H Target / orientation 
area (fixed pattern) 

^ Mode Data Area 
□ Data Area 



Orientation Markers 
Top Left 



Top Right 
Lower Left 
Lower Right 



Figure 5. High Level Structure of a Position Tag 



2.1 .1 Target and Orientation Area 

The target and orientation area consists of the fixed pattern shown in black and white in 
Figure 5. The format of this area is identical to that used in the Small Aztec Barcode. 

The black positions in are black macrodots, and the white positions are white macrodots. 
The 5-layer bull's-eye pattern is easily found in a 2D image by scans for topological con- 
nectivity, and is then useful for pinpointing the exact center regardless of orientation, and 
for determining the main axes and local x-y dimensions. On the four comers of the target 
are 3-bit clusters of orientation bits, which allow the tag's orientation to be quickly deter- 
mined. 
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2.1.2 Mode Data Area 



ile ^2^ h . T 'TJ ^he target (other than the orientation bits) com- 

M^e Da^^^^^^ T?-^ """" ''''''''^ -^^^ known as the 

Mode Data Area. The relative position of the 28 Mode Data bits can be seen in Figure 6 



Mode Data bit 0 



Mode Data bit 27 




Target/Orientation Area 



Figures. Mode Data Area 

t?/ Of nL'-"1^ meta-information used to decode the remainder of the position 

ntl? ^ J u ^' " '"^t^ information. If this bit is 0 then the 

tfTi v"' '''' " ^^"'"g '^"-^ > allows for redefinition 

Th me'trinrn^T '"'"^^^ """'^ """"'"^ ^"-P^^'"'- "-ting pages 

I he meta information and its encoding to 28 bits is described in Section 2.2.1. 



2.1.3 Data Area 



When the first bit of the meta information decoded from the Mode Data Area is 0 then the 
data area ,s defined to be the 1 68 bits as shown in Figure 7. 

i'eft aTd SSZTl''''' *^ '^'Sh layers, starting at the upper 

as aTeteTe ofre^i;^; '° ''f "^"^^ ^^^^ '"^^^^'^^^^ i"teT>reL 

a wavs Z^! 1 1 dommos", each 1 wide and 2 tall, with their more significant bit 

t^Z J^ '^'^^^ ^'^^ <^ '''^^'^ •"a^™*l°' represents a "1" bit and a white 

Z n k"'"'"'.' ' '^'^"^^ ^ '""^^^^^^ ^''^"^nce and orientatbn o7tLe 

dommos when turning the comers in the data area. orientation ot tne 



-H- 



Figure 7. Domino Mapping and Sequencing of Data Area 

The systematic domino-based layout of the data simplifies both encoding and decoding at 
the graphical level. The encoding mechanism for the data is described in SectTon 2 f 2 

^r^wLrheX'Sttl^^^^^^^ 
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Note that the 17x17 structure of the position tag means that with reference to the strict 
Aztec Code, the first layer of data is complete, but the second layer of data is only half 
full. If the second layer was completely full the position tag would be a 19x19 square cell 
with the target area in the center. 

2.2 Position Tag Encoding 

2.2.1 The Mode Message 

The 28-bit string in the Mode Area is used to hold 8 mode bits. These 8 mode bits describe 
how the remainder of the position tag bits are encoded. 

The 8 mode bits are encoded into 28 bits via Reed-Solomon encoding. The Mode Area 
therefore holds the 8 mode bits and 20 additional check bits. The 8 mode bits are parsed 
into two 4-bit words, and then 5 additional check words are computed by systematic 
Reed-Solomon encoding over the Galois field GF(I6) based on a prime modulus polyno- 
mial of: jc^ + X + 1 (=19 decimal). The generator polynomial of (x-2*)..(x-2'*) is: 

X + \\x +4x + ojc + 2 

Reed-Solomon encoding is chosen for its ability to deal with burst errors and effectively 
detect and correct errors using a minimum of redundancy. Reed-Solomon coding is dis- 
cussed in detail in [8], [4], and [3]. The reader is advised to refer to these sources for back- 
ground information. 

Table 3 shows the interpretation of the mode bits. Note that the first bit of the mode data is 
a version bit, and determines the interpretation of the remainder of the mode bits and the 
tag data. The Version bit should therefore be set to 0. Later interpretations of the tag can be 
defined at a later date via the version bit. 



Table 3. Interpretation of Mode Bits 



#Bits 


■^>\Namo 




0 


Version 


0 = the interpretation of the remaining 7 bits and the data area is 
as described in this document 

1 = reserved for future use 


1-2 


NumMsgWords 


Defines how many 6-bit codewords of the data area are message 
codewords, and how many are check-word codewords. This num- 
ber is determined by the encoding scheme used for data (see 
Section 2.2.2). Values are: 

GO = 15 data message codewords 
01 = 16 data message codewords 

10 = 17 data message codewords 

11 = 18 data message codewords 


3-7 


Reserved 


0 



'2.2.2 The Data Message 

The Data Area contains 168 raw bits, which is an encoded form of the 90 bits of position 
tag data (see Table 2). The 168 bits are represented by 104 bits in the first layer surround- 
ing the target area and 64 bits in the half layer surrounding the first layer. 

The 90 bits of position tag data are encoded into 168 bits in two steps. The first step breaks 
the 90 bits into codewords of 6 bits such that there are no codewords with all Os or all Is. 
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The second step Reed-Solomon encodes the data over the Galois field GF(64) which gen- 
erates additional 6-bit check words. ^ 

2.2.2.1 Step 1: Message Encoding 

In the first step of message encoding, the 90 data bits are arranged into a sequence of 6-bit 
message codewords in a generally direct fashion, starting at the most significant bit of the 
first codeword, with two key exceptions: 

• whenever the first 5 bits placed in a codeword are all "0"s, then a dummy "1" is 
codeword"'" codeword's LSB and the following message bit starts off the next 

• whenever the first 5 bits placed in a codeword are all "l"s, then a dummy "0" is 
inserted into that codeword's LSB and the following message bit starts ofl" the next 

codeword. 

In the end. the character and byte boundaries in the original 90-bit message have no neces- 
sary relationship with the codeword boundaries. Up to 5 bits may remain unfilled in the 
f mal message codeword, and they are padded out with "l"s (and possibly a final dummy 
u It necessary) to eliminate any ambiguity. 

The code-forming rules are designed to never create a message codeword of all Os or all 
IS, but the error encoding adds on additional codewords of any value. Thus during decod- 
ing an occurrence of those illegal values within the message region (but not within the 
Check region) can be regarded as a correctable erasure (this is more useful than not know- 
ing which codeword is in error). 

In the case of our 90-bit original messages, there are two cases to consider: 

• the best case is that 1 5 codewords are generated for the data message 

• the worst case is that 1 8 codewords are generated for the data message 

The codeword based message therefore consumes D 6-bit codewords, where D is in the 
range 15-18. 

2.2.2.2 Step 2: Generate Check Words 

The second step of message encoding involves generating the check words for the data 
message. Since the data message consumes between 15 and 18 6-bit codewords of the 28 
available codewords, the remaining 13 to 10 codewords can be used for check words. 

The additional check words are computed by systematic Reed-Solomon encoding over 
the Galois field GF(64) based on a prime modulus polynomial of:x^ + x+l (= 67 deci- 
mal). The generator polynomial is simply expanded out to (x-2')..(x-2'^) as needed at the 
adjusted^""""^' '^^ ""^^^^ "^""^ "^^y ^ message bits are 

2.2.2.3 Step 3: Place into Data Area 

The final message to be stored in the data area of a position tag consists of 28 6-bit code- 
words made up of D message codewords followed by AT check codewords. The exact num- 
ber of message codewords, D, is stored into the 2-bit NumMsgWords component of the 
Mode information for the position tag. 
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The resulting sequence of codewords is parsed anew into a sequence of 2-bit dominos (see 
Figure 8) and is then taken in reverse order and graphically arranged spiralling clockwise 
and outwards through the data area (see Figure 7). As decoding errors and tag damage are 
expected to occur more towards the edges of the tag, by reversing the codeword sequence, 
the message codewords occupy those edge regions. 



MSB 



LSB 



6 -bit codeword 



5 


4 


3 


2 


1 


0 



4 


2 


0 


5 


3 


1 



3 2-bit dominos 



Figure 8. Relationship of 6-bit codeword to generated dominos 

One macrodot is placed into the data area per bit. The placement of an IR-absorptive ink 
macrodot represents a "1". If there is no IR-absorptive ink placed on the page at the partic- 
ular location, then that macrodot represents a "0". 
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3 In-Pen Processing 



The pen must send the printer 100 samples per second. The mechanism for reading posi- 
lonal mformation from the position tags must work at this 100 Hz rate. The followine 
tasks must be performed each sample: 

• capture time, tilt and pressure 

• capture the image 

• locate the position tag 

• decode the position tag 

• build stroke information 

• activate the light as required 

• encrypt the stroke data 

• transmit the encrypted data 

When a pen-down is registered, we capture the first three frames at the two extreme focus 
values and the middle focus value. After that we perform regular auto-focus based on a 
Sharpness metric. In this way we are more likely to capture a "single-click" event. 

While the pen is in range of the printer, partially completed strokes are transmitted as they 
are bemg formed. When the pen moves out of range, stroke information is buffered within 
m^ttS^lSe?'''''*"'^^^'^ "^^'^^ physically on the page), and trans- 

Each pen contains a characteristics block which can be read by the printer. It contains at 
least the mformation shown in Table 4. 

Table 4. Pen characteristics block 



Name ; 




Pen Id 


A unique pen identifier - unique across all pens 




Modelld 


The model number of this pen^ 


Manufactureld 


The manufacturer of this pen 


Tiltlnfo 


The relationship between tilt and pen position. 



A^nT^r ^ ^.MUi.ieu wiin ivianuTaciureia to allow the printer to download a set of 
?sl"ch^'arrS^^^ ' ^^-^ 



3.1 Position Tag Decoding 

3.1.1 Capture Time, Tilt and Pressure 

The pen contains sensors which allow pen tilt and nib pressure to be determined. 



3 1.1.1 Time 



All measurements are made in the context of a particular timestamp. The pen contains a 
timer to allow equally time-spaced measurements to be made. Although we capture sam- 
ples at a rate of 1 00 per second, we report time at millisecond resolution to allow for future 
improvements to the pen. Time resolution is provided at 32 bits. 
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3.1.1.2 Tilt 

The pen contains two orthogonal passive accelerometers in the x-y plane perpendicular to 
the pen axis. These respond to gravity and allow two-axis tilt to be computed to an accu- 
racy of at least 5 bits. 

Tilt is required to determine the nib position. The printer uses the two tilt values and the 
pen's non-corrected pen position to determine the actual pen nib position. The Pen Char- 
acteristics Block contains the relationship required for the calculation. Offloading the cor- 
rection calculation to the printer reduces pen complexity and price. 

3.1.1.3 Pressure 

The pen contains a pressure sensor which measures to an accuracy of at least 5 bits. From 
the pen's point of view, the pressure value is only used to determine whether the pen is on 
the paper or not. The printer is responsible for all other interpretations of pressure, such as 
determining whether an item on a page is being selected. The pen merely passes the pres- 
sure value on to the printer. 

Each position tag contains a data bit called PressureSensitiveArea. If a given pen stroke 
includes position tags that have their PressureSensitiveArea bit set, then the pressure value is 
passed as part of the stroke information. If the PressureSensitiveArea is clear, then pressure 
is implied from a stroke in terms of pen-down and pen-up. 

3.1.2 Capture the Image 

The image needs to be captured for the pen position to be determined. This only needs to 
happen if the pen is on the page. 

To capture an image, data must be transferred from the image sensor to a fixed image 
buffer. This process involves a single read and write per pixel. The minimum and maxi- 
mum values encountered during the transfer are kept in variables MinPixelEncountered and 
MaxPixelEncountered, respectively, for later use in the data recovery process (see Section 
3.1.4). 

There are a number of general considerations that are part of the assumptions for reading 
in and decoding a position tag from an image sensor. 

With regards to the image sensor itself, there are two calculations to consider: the size of 
the sensed area, and the resolution of the image sensor. As described in Section 3. 1 .2. 1 and 
Section 3.1.2.2, the sensed area has a required size of 193x193 dots (or 3.06mm x 
3.06mm), and the image sensor has a required resolution of 96x96 pixels. 

Furthermore, as discussed in Section 3.1.2.3, the sensed image may be blurry, and the 
sense of ambiguous macrodots may have to be inferred. 

A 96x96 image contains 9216 8-bit pixels. We round this up to 10,000 pixels for calcula- 
tion purposes. The transfer process involves on average 6.5 cycles per pixel for a total of 
65,000 cycles per position tag. On a 25 MHz processor this represents 26% of the avail- 
able bandwidth. 

3.1.2.1 Sensed Area Size 

The basic position tag consists of 17x17 macrodots. Since each macrodot is a 4x4 array of 
printed dots, each position tag in fact consists of 68x68 printed dots. 
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To ensure that one entire tag is always within the window of the image sensor the image 



worstlt^t^r P^%7,V^'^^t P°^itionaI tags at any rotation, we must consider the 
793x193 ™' increases the sensed dot area to 

f9Vxm dorf 'k"k '^'^^ """^^ ^^"^^ ^ P""^ed area containing 

I93X190 dots, wh.ch equates to 3.06mm (0.12 inches) in each dimension. ^ 

3. 1.2.2 Image Sensor Resolution 

" """^ ^""^^^ '° ^ "-''^ — --'"tion of 

To ensure that one entire tag is always within the window of the ima<>e sensor the ima^e 
S trr4xT4.'""' ^^'^ -reLeXseitTeS! 

fotatton of S dT^rlffrf '"^ """^^ --i'^- «he worst case 

rotation of 4d degrees. This requirement increases the sensor resolution to 48x48. 

lltf '^"u^ Nyquisfs Theorem with respect to macrodots. we must oversample at 
least at t^v.ce the macrodot resolution. This leads to a sensor resolution of 96x96 

e^ctoTxTcfn ' ""^'t^' ""^^ ^^^"'"^ '^^^^ ^'gnifi'^ant 2 bits of 

each p.xel can contam no.se. Decodmg algorithms must therefore be noile-tolerant. 

3.1.2.3 Blurry Image 

mechaSsm to LnH^lI^h '^^P^'^-^f-^^'d' ^-d the pen includes an auto-focus 

mechanism to handle changes in pen-paper separation due to varying tilt etc but several 

fesTonsr^nJv ""^''"^^ """'""^ "P'"^^'' ^^S^' -dud^ng taS^ au to-focu 
response, and varying pen-paper separation due to extreme tilt or warped paper. 




no blurring 








severe blurring 



Figure 9. Effect of different degrees of blurring 
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Blurring can prevent definitive macrodot recognition. Figure 9 shows the effect of blur- 
ring on a position tag composed of macrodots, ranging from no blurring to severe blurring. 
Note how isolated macrodots fade as the blurring becomes more severe. 

As the blurring increases, the more a given macrodot is influenced by the surrounding 
macrodots. Consequently the dynamic range for a particular macrodot decreases. Consider 
a "white" macrodot and a "black" macrodot, each surrounded by all possible sets of mac- 
rodots. The 9 macrodots are blurred, and the center macrodot sampled. Figure 10 shows 
the distribution of resultant center macrodot pixel values for black and white macrodots. 



Range of black macrodots 
(frequency dis::ribut ion) 



Range of white macrodots 
(frequency distribution) 



100 ISO 

Center macrodot pixel value 



Figure 10. Black-white macrodot ambiguity due to blurring 

The curve in Figure 10 is computed for an illustrative degree of blurring. The curve from 
pixel values 0-180 shows the range of black macrodots. The curve from pixel values 
75-250 shows the range of white macrodots. The greater the degree of blurring, the more 
the two curves shift towards the center of the range and therefore the greater the intersec- 
tion area, which means the more difficult it is to determine whether a given macrodot is 
black or white. A pixel value at the center point of intersection is ambiguous - the macro- 
dot is equally likely to be black or white. 




Probability of a codeword being in error during a read 

Figure 11. Relationship between data non-recovery and codeword error rate 

As the blurring increases, the likelihood of a read bit error increases. Fortunately, the 
Reed-Solomon decoding algorithm can cope with bit errors gracefully up to / symbol 
errors. Figure 1 1 shows the predicted number of Reed-Solomon codewords that cannot be 
recovered given a particular symbol error rate. Notice how the Reed-Solomon decoding 
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dlZ J T' f substantially degrades. If there is no Reed-Solomon block 

cot e w "h °? • '°'r"' "'^'^ ^"-^^ *° ^ un..coverable. Of 

Tt V de^^J • ThT"" ("''^ codewords), the chance of cor- 

rectly decoding the data increases. 

r?orTher!^!f H'^'r^^''' "^^"^ '° of Reed-Solomon codewords in 

numbeT of V ^'"^''^-^^ ^^e amount of blurring that can be corrected, and th^ 

e^r detecSnTd , "^P" ''^"^^^ '^'^^ Since al 

eiTor detection and correction is performed by the Reed-Solomon decoder there are a 

ImbeT'f "'^"""r"" '^^^''-So'o-on data block that can be corrected. T^f laier he 



3.1 .3 Locate the Position Tag 



tlon camels '^h' ^^"P'^^" P--'-" -fo""- 

The first step in locating the tag is to locate a bull's-eye target (Figure 5) within the imase 
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Area of interest 



Entire image 



(95,95) 



3.1.3.1 



Figure 12. Area of interest for target location 

tl!e"tLo^,'""'''!K'^ """uf '^""'P'^'^'y <=<^"'^i"e<l vvithin the image, the data area outside 
the target must be visible. As a result, the area of interest for localing targets is actually a 

88x88 '"l^^^- i-^-^^ ^^-^-^-S a 96X96 image, we^nTn ed s -c 

88x88 image (a reduction of 1 5% from 92 1 6 samples to 7744). 

The 5-layer bulls-eye pattern of the target is easily found in a 2D image by scans for tooo- 
ogical connectivity, and is then useful for pinpointing the exact centef regardles of orien- 
tation, and for determining the main axes and local x-y dimensions. 

Scan for Topological Connectivity 

Prior to image traversal we initialize an 88x88 array of flags with 0 This arrav keer,^ the 
Tte^^heS JrsToTr''"^ ° - havTLt x t 
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We then start with the top left pixel and compare adjacent pixels in order to build a con- 
nectivity structure for the top left pixel. If the top left pixel is considered to be white, then 
the connectivity structure will represent all connected pixels that are also white. If the top 
pixel is considered to be black, then the connectivity structure will represent all connected 
pixels that are also black. As edges are met due to differences in color sense, adjacent con- 
nectivity structures are built. 

The order of pixel traversal in the image simply follows a standard pixel fill algorithm. 
There are many such algorithms to be found since this is a useful operation for paint pro- 
grams. Near-optimal algorithms such as [1] and [2] only read each pixel once on average. 

In our case we must also consider the notion of color sense. Target location does not 
require the sophistication of the macrodot reading algorithm for mode bits and data bits 
for determining if a macrodot is black or white (Section 3.1.4.2 and Section 3.1.4.4). The 
minimum and maximum pixels encountered during the image capture were stored in Min- 
PixelEncountered and MaxPixelEncountered respectively, and these are used to set the thresh- 
old for black/white as MidRange = (MinPtxelEncountered + MaxPixelEncountered)/2. Anything 
greater than or equal to MidRange is considered to be white, and anything less than 
MidRange is considered to be black. 

As each connectivity structures is completed, it is compared against the expected values 
for the 5 bulTs-eye layers surrounding the target center. Possible matches are added to one 
list, while non-matches are discarded. 

The total time taken for processing the image is approximately 6 cycles per sample pixel. 
This equates to 46,464 cycles (88x88x6), or 19% of the available processor bandwidth. 

3.1.3,2 Determine Target Axes 

The connectivity structures can now be examined together in order to locate the target. 
The identification of two or more concentric structures is enough to determine the x and y 
axes. 

Taking one of the completely isolated concentric structures, 2 points on each of the 4 sides 
are chosen where the distance separating them is at least 3 pixels. For each point, the pixel 
of maximum whiteness or maximum blackness is chosen as the estimate of the center of 
the line. The estimate should be within I pixel of the actual center. 

The process of building a more accurate position for the line center involves reconstruct- 
ing the continuous signal for 7 scanline slices of the line, 3 to either side of the estimated 
center. The 7 maximum values found (one for each of these pixel dimension slices) are 
then used to reconstruct a continuous signal in the column dimension and thus to locate 
the maximum value in that dimension. 



// Given estimates column and pixel, determine a 

// betterColumn and betterPixel as the center of the target 

for (y=0; y<7; y++) 

{ 

for (x=0; x<7; x++) 

samples[xl = GetPixel (column-3+y, pixel-3+x) 
FindMax (samples, pos, maxVal) 
reSamplesty] = maxVal 
if (y 3) 

betterPixel = pos + pixel 

) 
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FindMax(reSamples, pos, maxVal) 
betterColumn = pos + column 



Hdges ID/ ns in 16J). The function and kernel are shown in Figure 13: 




Lanczos ."}(.«■) = / _ ~ — ~- 1*1 <;< 



Lit > :} 



Figure 13. LanczosS windowed sine function 
for points blu^een X and xfl ' 7 ^^^^ '^."""^ ^ '"^'^ ^'^^ ^°"volution icemel 

3.f.3.3 Determine Target Center 

m order to locate the actual center of the target there are two cases to consider. 

• The center of the target is one of the connectivity structures 

• The center of the target is not one of the connectivity structures 

i^wfthln 'iSlTf tt°r P"-' °f '•'^ estimated target center, which should 

the tilt Center invlll? ""'^^The process of building a more accuiate position for 

each of ti?«r ' '*'.°'^''^e. estimated target center. The 7 maximum values found (one for 

thfcoful di^nlrnd r T,'^ "^^^^ '° ^"""^^-^^ ^ continuous sSn:. ° 

cess IS thTsarrr K H c ''^^ "^^'•"""^ ^^'"e in that dimension. The pro- 

cess .s the same as described ,n Section 3. 1 .3.2 and uses the same filter as shown in Figure 
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If there is no current estimation for the center, the center is considered to be the calculated 
center of the four lines used in the calculation of the axes in Section 3.1.3.2, This process 
can be repeated for another isolated bull's-eye layer and the two estimates for target center 
averaged. If the estimated center pixel is black, a more accurate center can potentially be 
obtained by following the procedure defined for the first case. However care must be 
taken since this pixel region is not completely isolated (or there would have been a target 
estimate in the connectivity structures). It may be enough to increase the accuracy in only 
one dimension. 

3.1 .4 Decode the Position Tag 

With the position of the tag known, the task of decoding it can begin. Decoding a posi- 
tional tag consists of 3 essential steps: 

• Determining the orientation of the tag 

• Extracting the tag's mode data and decoding it 

• Extracting and decoding the data portion of the tag based on the mode data 

3. 1.4, 1 Determine Orientation 

On the four comers of the target are 3-bit clusters of orientation bits, which allow the tag's 
orientation to be quickly determined. 

Using the Ax and Ay values (obtained in Section 3.1.3.2), and applying them to the accu- 
rate target center coordinate (obtained in Section 3.1.3.3), we are able to calculate the esti- 
mated positions of the 12 orientation macrodots. 

Given the macrodot coordinate (fixed point) we sample 4 image pixels to arrive at a center 
pixel value via bilinear interpolation. 

Once the center pixel value has been determined, we try to determine the bit value for that 
macrodot. To do so, we take the pixel values representing the macrodot centers to either 
side of the macrodot whose bit value is being determined, and attempt to intelligently 
guess the value of that center macrodot's bit value. Looking at the generalized blurring 
curve again (reproduced in Figure 14 from Figure 10), but with BlackMax and WhiteMin 
shown, there are three common cases to consider: 

40 « • * * 

Range of black macrodots Range of white macrodots 

(frequency distribution) (frequency distribution) 



WhiteMin BlackMax 



100 ISO 

Center macrodot pi.xel value 



Figure 14. Black-white macrodot ambiguity due to blurring 

• The macrodot* s center pixel value is lower than WhiteMin, and is therefore definitely a 
black macrodot. The bit value is therefore definitely I. 
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* wh!,eTJ''H tI!''I;'"^',' ^'^*=^'^^''' ^"^ therefore definitely a 
white macrodot. The bit value is therefore definitely 0. 

* Zl^T'^^V^'u!"/'''^^ somewhere between BlackMax and WhiteMin The 
tTon A ° "k^ ' ""'^ " ""^^ '^''^ -^'"^ 'he bit is therefore in ques- 

acclnt thl^^^^^^^ '""'^ "^'^"^ ^"'"P'^'^'ty -8-'"st accuracy, and also take into 

account the fact that m some cases, there is no guaranteed solution. In those cases 

somToTh " " T"! ^'^ be corrected by 

some other means (m the case of orientation bits, the other comers may help and in 
the case of the tag's data, the Reed-Solomon decoding stage will coirect erroS. 

dotneed! ^ K ""^""Tt^ ^^"^ P''^^' ■^"S^^ "Wack" and white 

sea ch for the ^^""^'^''-Jhe minimum and maximum pixels encountered during the 
The foltwinV ^ r rt and MaxPbcelEncountered respectively 

I^ Jm^ZZT'^Iu of obtaining good values for WhLin and 

BlackMax based on the mm & max pixels encountered. 



MinPixel = MinPixelEncountered 
MaxPixel = MaxPixelEncountered 
MidRange = (MinPixel + MaxPixel) / 2 
WhiteMin = MaxPixel - PenConstantWhiteFactor 
BlackMax = MinPixel + PenConstantBlackFactor 



* IZ^^, T to either side are on the white side of MidRange (an average mac- 
be a definite white. The fact that it is in the not-sure region would indicate that the 
irth" vTueT' rl' T^'^' whit: r^odols o 

* tha? tfTe TT"""'" '° '"^^ °" "'"'^'^ ^'^^ then we can guess 
ha t sin htnoT" "'S'.'* ''"^'y ^ "''^""'te" black. The fact 

t^en affJ. Jh K 1 '"'^'"'^ ''^^ '^^"0'l°t was white, and had 

m^ln r f ^ surrounding black macrodots to make the value less ure The 
macrodot value is therefore assumed to be white, and hence the bit value is 0 

* white'sl^e o^Jhr' °" the other macrodot is on the 
white side of MdRange, we simply use the center macrodot value to decide If the cen- 

The logic is represented by this simple pseudocode: 



if (pixel < WhiteMin) // definitely black 

bit = 0x01 
else 

if (pixel > BlackMax) // definitely white 

bit = 0x00 
else 
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if ( (prev > MidRange) && (next> MidRange) ) //prob black 

bit = 0x01 
else 

if ((prev < MidRange) && (next < MidRange)) //prob white 

bit = 0x00 
else 

if (pixel < MidRange) 

bit = 0x01 
else 

bit - 0x00 



From this one can see that using surrounding pixel values can give a good indication of the 
value of the center macrodot*s state. The scheme described here only uses the macrodots 
from the same row, but increased accuracy may be achieved using all the neighboring 
macrodots, at the cost of increased complexity. 

We already have the distance between the macrodots in terms of a Ax and a Ay with 
respect to the current orientation of the image. Rather than rotate the image to transform 
Ax and Ay both to 1, we simply change the sense of the Ax and Ay values based on how 
many sets of 90 degrees it takes for the tag to be oriented so that both D values are posi- 
tive. The four possible rotations by 90 degrees equate to 4 different combinations of signs 
(±Ax and ±Ay). It is therefore trivial to translate Ax and Ay into two deltas for movement in 
X and y: Ax^ and Ay^ for movement of I macrodot in x, and Axy and Ayy for movement of 1 
macrodot in y. 

With the 12 orientation bits obtained, the orientation of the tag can be easily determined. 
Given 4 sets of 12 bits, the correct orientation is the one that minimizes the number of bits 
in error, as shown in Table 5. 



Table 5. The four major orientations of the position tag 



: 12-bit vialue ^ ! ^ 




111-011-100-000 


No rotation 


011-100-000-111 


Rotated clockwise 90 degrees 


100-000-111-011 


Rotated clockwise 180 degrees 


000-111-011-100 


Rotated clockwise 270 degrees 



3.1,4.2 Extract the Tag's Mode Raw Data 

With the orientation determined, the next step is to read the bit pattern representing the 
Mode bits from the tag. 

We know the coordinate of the tag's target center as [Centerjj, Centery]. We also know the 
orientation of the tag and therefore have Ax^ and Ayx for motion in x, and Axy and Ayy for 
movement in y. These delta values enable us to step along the center of any macrodots. By 
sampling the tag at the 18 mode bit positions (see Figure 6). Consequently the location of 
the first few mode bit are: 

• BitO location = [Center^ - SAx^ - 5Axy, Centery - SAy^ - 5Ayy] 

• Biti location = [BitOx + Axy^, BitOy+Ayjd 

• Bit2 location = [Bitl^ + Ax^, Bitly+Ayx] 

Given the macrodot coordinate (fixed point) we use the sampling mechanism as described 
in Section 3. 1 .4. 1 to extract the bit value. 
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Issum!ir''*'1 V ^PP^ox-^^^^^ly 168 cycles on a simple microprocessor. 

0 of"L . m m' ^^"^P'^ represents less than 

0. 1 /o of the available processor bandwidth. 



3.1.4.3 Decode the Mode Data 



^if.??" » J!''*"!-^ representing the tag's mode data has been read in. It must now be 
decoded mto 8 bits of meaningful mode information. 

The data is decoded using straightfonvard Reed-Solomon decoding One of the advan 

Inverse) ^"^ ""'^ °^ """'''P'y ^"^ '""'^'P'y 

The decoding process of 28 bits to 8 bits will take approximately 1500 cycles on a simple 

l^irZriof °;-,^""Tf.' '^"^ '''' ^y''^^ P- position sampTe' 

less than I % of the available processor bandwidth. 



3. ^.4.4 Extract the Raw Tag Data 



Before the tag datz proper can be read in from the tag image, the tag's 8-bit mode data 
Tr^ In ^^^^^^^^^^^ — e known and can 

Jn^\'!!Z°^°V^^'T''''^^ '^"'^ ^'"^ '^^^ ^ '68-bit raw bitstream accord- 
Zd^TZ ^Tr^ ?"'^^ '"S's target center [Center,, Center,] 

and the orientation delta values Ax, and Ay„ Axy and Ay, to calculate the start pos tion. The 
delta values also enable us to step along the center of the data area's macrodots. 

Jn^ZT^\u^'^^'f'^''''i"^ ^ macrodot is a 1 or a 0 is the same as that carried out 
tor reading the tag s mode bits and orientation bits (see Section 3. 1 .4. 1 ). A total of 168 bits 

'l008 cvH«°"' ^r^" ^''^^"io" °f '68 bits will take approximately 

I U08 cycles on a simple microprocessor Assuming a clock speed of 25 MHz 1008 cycles 
per position sample represents 0.4% of the available processor bandwidth. ' 

3. 1.4.5 Decode the Tag Data 

Jif^H^H T '^P'"««"t'"8 the tag data has been read in. It must now be 

decoded into the Pageld, x and y coordinates etc. (see Table 2). 

^ '''^'■d^d '"to '"^ssage data codewords and check words. 
Assuming that the Version bit is 0, the 2-bit NumMsgWords field in the Mode area deter- 
mines the number of message data codewords D as 15, 16, 17. or 18. The remaining AT 
codewords are check codewords. ■••"img a 

Each of the D 6-bit message codewords can now be examined to see if it is all Os or all 1 s 
Any such codeword is illegal (due to the encoding process) and can be considered to have 

ca^hu'^l ^ '^^ """" ^'^'^ '"^^^^^^^ the error correction 

capabilities of the check bits. 

The data can then be decoded using straightforward Reed-Solomon decoding. One of the 
advantages of using Galois Field GF(64) is that a total of only 256 bytes are required for 
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lookup tables during the decoding process (64 bytes each of power, log, multiply and mul- 
tiply inverse). 

The decoding process of 168 bits to 90 bits will take approximately 4000 cycles on a sim- 
ple microprocessor. Assuming a clock speed of 25 MHz, 4000 cycles per position sample 
represents 1 .6% of the available processor bandwidth. 



The information gained from the position tag is either ignored or added to the current 
stroke depending on whether the pen is deemed, based on nib pressure, to be up or down. 
If the pen is up but was down, then the current stroke is fmished. If the pen was up but is 
now down, then a new stroke is started. 

Each stroke contains the start time (in milliseconds) followed by the recovered page id and 
initial position. This is followed by a series of positions for the stroke. The positions are 
implicitly separated by lOOths of a second in time. While the first position is always abso- 
lute, subsequent positions are either delta-encoded or absolute as required. Escape codes 
allow compression for a number of unknown positions (the tag cannot be found), the 
encounter of different page ids (for example the initial page id is unknown and fmally a 
page id is recovered from a tag during the stroke, or it may be that the pen crosses from 
one page to another during a stroke), and the encountering of tags with differing Pressure- 
SensitiveArea values, which enable or disable the inclusion of a pressure value with each 
position. Pressure values are typically included for the entire stroke if the stroke begins in 
a pressure-sensitive area. 

The following is a definition for a stroke: 



stroke = time PageldRec FirstPosRec {[PosRec I PressurePos I Escape]} endStroke 

PageldRec = [unknown I pageld] 

Escape = [pageld I pressureMode I TimeSkip] 

TimeSkip = (unknown I zeroDelta] shortTime 

PressurePos = PosRec penPressure 

PosRec = [PenAbsRec I PenDeltaRecJ 

FirstPosRec = [unknown I PenAbsRec] 

PenAbsRec = tagCoordinate imageCoordinate macrodotDelta tilt 
PenDeltaRec = penDelta imageCoordinate macrodotDelta tilt 

where : 

time = 32 bits unsigned (milliseconds) 
ShortTime ^ 16 bits unsigned (milliseconds) 
pageld = 64 bits unsigned 

tagCoordinate =2x9 bits unsigned (representing x and y) 

imageCoordinate = 2 x 10 bits unsigned fixed point 7:3 (representing x and y) 
macrodotDelta =2x8 bits signed fixed point 83:4 (representing Ax and Ay) 
penDelta =2x4 bits signed (representing -8.. 7 for x and y) 
penPressure = 5 bits 

tilt =2x5 bits (representing 2 tilt axes) 
pressureMode = 1 bit 



The length of a sample position is 64 bits (18 + 20 + 16 + 10) when the pen coordinate is 
fully described, and 52 bits (18 + 8 + 16 + 10) when the pen coordinate is a delta amount. 
Adding flag bits to specify that there is no escape mode (1 bit) and to select between abso- 
lute and relative position (i bit), we specify 66 and 54 bits respectively. 

The initial position requires 162 bits to define (32 + 65 + 65). 



3.1.5 



Build Stroke Information 
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Tn ini.f i"*"^ ^ Vlf^ P^^^ ^ '^*=°"<^^' assuming no read errors, there is 

n 62 ! noT '° 'T'^ ''^ ^^o"^- is therefore 2 1 708 bi 

( 1 62 + (399 X 54)). which is 27 1 4 bytes, or 6.8 bytes per sample. 

pL'TureSeni^'T " kT' "J-'' "'H ^''^P^"'""^ °" ^'^^ ''^'^^ encountered 

PressureSens-^veArea b.ts w.thm each tag), a further 5 bits are required for each position 
The Escape of pressureMode allows the toggling of this state within a stroke. 

J^LTf^' ''f ""^"^ 'he initial position 

(pageld. coordinates etc ) .s unknown due to the inability to locate a tag or recover ag 

til I T "''"^^'^ unknown. This initial position may be 

followed by an Escape of TimeSkip, signifying the amount of time where unknown posi- 
tions were captured. Finally, when a tag is captured and decoded successfully the Escape 

nn?/rS' V'^- ^-^ ^^^"^'^ ""''^ P^S^'-^* is i"<='"ded in the stroke 

(inserted when a tag is encountered with a pageld different to the current kno^vn pageld) If 
a tag cannot be found or decoded successfully mid-stream within a stroke, the Escape for 
SlTnlJH '1"'"'^' ^""^f" ^eP'-esents the elapsed time where only unknown positions were 

nnTr^H 1 " T" ^t" '^''^"^^ *^ P^S^'"" Positions are reac- 

quired, the page id may be changed, depending on the tag. A Timeskip entry for a set of 

andTbirT H^r" 1 ^ '"'^^ '° '^^^^ '^e type oTescape code 
and 1 6 bits to define the duration of samples skipped. 

The other use for the Escape of TimeSkip is when there have been one or more deltas of 0 
The Escape of zeroDelta combines with a 16-bit time amount to specify how long the pen 
has remained in the same position without moving. * c pen 

s^^u'cZ ZT'Z °' '° information both during stroke con- 

^oo " ""^"^"^^ P""^"'- A buffer allows for approxi- 

stroke capture. The exact duration will depend on the success of tag decoding, and 
whether or not continuous pressure is being captured. 

nl!^H '''^ ^^^'^^^ ft'"' a Buffer-FuII LED is illuminated. The LED stays illumi- 
ml.H? 1 cof"" i"to range of a printer, whereupon the buffered strokes are trans- 

mitted to the printer and the buffer freed. 

3.1.6 Activate Active Area Light 

JlnZ'^'Tu iT. ""^^ ^ ^'^^ '^^'"^ 2). The pen's active area 

tt.ST. Tu ^'^"'^ '■^'P°"'' '° ^^'"^ °f t'^is There is no additional 
interpretation of the AcfiveArea bit by the pen. 

3.2 DATA Encryption 

Javesd'ronnrcT """'^ ''^""^'>P'^'' before being transmitted to the printer, to prevent 
eavesdroppers from capturing pen input, and particulariy signature input. 

Consequently, the final stage before transmission is the encryption of the data stream. 
Symmetric encr>-ption is used since it is tractable in the time available. Possible symmetric 
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algorithms for use are listed in Table 6. In all cases, a minimum key size of 14 bytes is 
assumed. 



Table 6. Symmetric encryption algorithms [5] 




Blowfish Block 18 8 4-56 No 



CAST Block 20 8 16 • Yes. but free 

IDEA Block 50 8 16 Yes 

Tripie-DES Block 108 8 14a No 

a. Although Triple-DES uses a 168 bit key, the effective key strength is only 112 bits 

Of the algorithms listed in Table 6, Triple-DES is the most conservative choice, although 
it is the slowest. At 108 clocks per byte processed, the encoding of a single 8-byte block 
consumes 864 cycles (8 x 108). 

The pen must send 100 encrypted samples each second. Assuming that each sample 
requires a complete Triple-DES block (8 bytes), the time taken to encrypt 1 second of data 
is 86,400 cycles. 

For a clock speed of 25 MHz, 86,400 cycles for the 100 samples equates to less than 0.5% 
of the processor bandwidth. 

The encryption process therefore has a throughput of 800 bytes per second. 
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1 Netpage Applications 



Jilbns'Sl'JT- ""h' '° '^fr ""'"^ •"'^^'^''^^ ^^'"P^ter appli- 

cations nomially delivered v.a networked computer terminals such as Web terminals. 

iseMn!^'f ^^'^'^'T' ^ "^^^ "P'S"" '"'P'^y^'' °" 'he terminal screen provide the 

P ovide .hr .^PP'-^^r • ""^'P^^^ P^^'^S-, a series of printed' Netpages 

provide the user interface to the application. 

r?ll^lr'"® '""T ""^""^ ^ ^'^P^S' applications, including user and pen 

registration, news subscription, electronic mail (e-mail), and various examples of elec- 
vZ oTlT'"^''"" (e-commerce). In each case the application is described from the point of 

1^.1 ?• ^^'P^S^ by the user and the object 

model implicitly manipulated by the user through the user interface. 



1.1 Object Model Description 



Each object model is described using a Unified Modeling Language (UML) class diagram 
KnH f f P*" ^'^5" connected by relationships. Two 

r^nr.? f "l' °^ ^s°«='^tions and generalizations. An association 

represents some kind of relationship between objects, i.e. between instances of classes. A 
generalization relates actual classes, and can be understood in the following way: if a class 
s thought of as the set of all objects of that class, and class A is a generalization of class B. 
hen B IS s.mpiy a subset of A. The UML does not directly support second-order model- 
ling - I.e. classes of classes. 



department 



I 



lecturer 






position 






teaches 


course 




name 

de^ript'ton 
timetable 




attends 


stutfient 





pereon 



name 
addreee 
date of birth 



Figure 1. Illustrative UML class diagram 

Each class is dravvn as a rectangle labelled with the name of the class. It contains a list of 
the attributes of the class, separated from the name by a horizontal line, and a list of the 
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operations of the class, separated from the attribute list by a horizontal line. In the class 
diagrams which follow, however, operations are never modelled. 

An association is drawn as a line joining two classes, optionally labelled at either end with 
the multiplicity of the association. The default multiplicity is one. An asterisk {♦) indicates 
a multiplicity of "many", i.e. zero or more. Each association is optionally labelled with its 
name, and is also optionally labelled at either end with the role of the corresponding class. 
An open diamond indicates an aggregation association ("is-part-of), and is drawn at the 
aggregator end of the association line. 

A generalization relationship ("is-a") is drawn as a solid line joining two classes, with an 
arrow (in the form of an open triangle) at the generalization end. 

When a class diagram is broken up into multiple diagrams, any class which is duplicated is 
shown with a dashed outline in all but the main diagram which defines it. It is shown with 
attributes only where it is defined. 

Figure I illustrates the subset of the UML class diagram notation used here. 



Each application user interface flow is illustrated as a collection of documents linked by 
command arrows. A command arrow indicates that the target document is printed as a 
result of the user pressing the corresponding command button on the source page. Some 
command arrows are labelled with multiple commands separated by slashes (Vs), indicat- 
ing that any one of the specified commands causes the target document to be printed. 
Although multiple commands may label the same command arrow, they typically have 
different side-effects. 

In application terms, it is important to distinguish between Netpage documents and 
Netpage forms. Documents contain printed information, as well as command buttons 
which can be pressed by the user to request further information or some other action. 
Forms, in addition to behaving like normal documents, also contain input fields which can 
be filled in by the user. They provide the system with a data input mechanism. 

It is also useful to distinguish between documents which contain generic information and 
documents which contain information specific to a particular interaction between the user 
and an application. 

Each document type has a distinct iconic representation as shown in Figure 2. 




Figure 2. Document icons used in user interface flows 

Generic documents may be pre-printed publications such as magazines sold at news 
stands or advertising posters encountered in public places. Forms may also be pre-printed, 
including, for example, subscription forms encountered in pre-printed publications. They 
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requ'esl"""'- '^"■"'""^ ^ ^^P^g^ Printer in response to user 

'^'^ZZlelt^^^^^^^ °" "y by a Netpage Printer 

fix<^^:f information 

I variable in^orma tioTi 
I 

( input field ^ 



1 



(^command button^ 
I ♦ I list of dra^^able objects or attributes ~[ 

Figures, Page layout elements 
J^SetXts" r natr^'r ' ^"-^her described as abstract 

1 .3 Netpage User Interface Design Guidelines 

1.3.1 Input Feedback 
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nonetheless provided in the shape of the next form in the user interface series, or a transac- 
tion receipt, or some other requested document. 

The user also uses the marking nib of the pen to input commands which don't require 
immediate mterpretation, such as text editing markups. 

The following are examples of input typically made with the marking nib: 

• handwritten text 

• drawing 

• checkbox mark 

• signature 

• text editing command (strikeout etc) 

• drag-and-drop (from list of objects, etc.) 

• drag-and- lasso (from palette of colors, line styles, etc.) 

The following are examples of input typically made with the non-marking nib: 

• selection by circumscription 

• button press 

1.3.2 A Minimum Unit of User Interface Output 

A Netpage Printer prints at a constant page rate, independent of whether pages are printed 
on both sides or not, and independent of the pages' actual content. 

A single page printed on both sides at high resolution in full color is therefore a useful 
minimum unit of user interface output. This minimum unit of output has an informa- 
tion-bearing capacity equivalent to ten SVGA computer screens. So although a Netpage 
application is designed to produce less frequent output than the equivalent screen-based 
application, it has ten times the "display" area of the screen-based application when it does 
produce output. 

Furthermore, previous pages printed as part of the user interface flow continue to act as 
part of the user interface, and multiple applications can be active simultaneously without 
competing for screen space and forcing the user to switch between them on the screen. 
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2 Directory Navigation 



A directory is an organized list of named obiect^ if m,w u 

sorted alphabetically, arranged into named gr^s or o^- ^./r^^i '? "^'"^ ^^y'' 
■s specflc to each kind ofdirectory. A direcfo;"^:a;",r S slUe^ 

norc^aTn™^^^^^^^ ^'^'^ 'f^ ''^^ ^'^^ each 

tvvo pages hold ^ enLs and the en«^^ed^^^^^^^^^ ' ^^^^'-sided sheet), 

levels in the index is Jog^rr, For Lamnl r.!^ ° ^''"^ number of 

di.cto, contains ^O0O.Vo0o7ntStntr„S^^^^^^^^ 

entiy acts as a hyperlink fo1he co.^e^^^^^^^^^ ^^'^^ ^^^h index 

generic directo^Tdexpagets shrnTn ptui'r"''"' "'^'^ '^^^"^ 

If the entire director, fits on two pages, then it is presented di.ctly without an inte.ening 
The indexed directory class diagram is shown in Figure 20. 
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Figure 4. Indexed directory class diagram 
<to> bancs whfch prinMh n^, 1*° ' <P™vlo„s>. <„ex.> and 
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Each page also contains a <search> button which generates a search form which allows 
the directory to be searched. The contents of the search form are specific to each kind of 
directory. 

The directory navigation user interface flow is illustrated in Figure 5. 



first/prev/next/iast 




first/prev/next/la&t 



G 



directory 

index I ^ entry 



up/ top 




terminal 
directory 

Index I «"^ry 



search 



search 
directory 




eearch 
(unic^ue) 



search 
(ambiguous) 



list of 
matches 



Figure 5. Directory navigation user interface flow 

The meaning of the standard navigation buttons on the directory index page is described in 
Figure 6. 
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Figure 6. Standard directory index navigation button 
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PJ rectory Index 



^J'^^^yna^e^to'endTn^ ' 
sta^iy name to'endTnq nanye ' 
^'^rt\nqname to'endTn^ na^ ' 
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^^rtiyjyame to'endTnq name ' 
starting name to endfn^ name ~ 
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starting end i>i J" n"ame " 
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starting name to'endTnq name 
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search ^ 



Figure 7. Generic directory index page 
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3 User Registration 



Much of the Netpage System is predicated on the system's secure knowledge of user iden- 
tity. This allows the system to: 

• deliver personalized services to individual users independent of location 

• support authenticated transactions 

• support secure payments 

• guarantee a high level of privacy 

3.1 User Object Model 

The user object model revolves around a uniquely identified user, as shown in the class 
diagram in Figure 8. 
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Figure 8. User class diagram 
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A user is authorized to use any number of nrinfprt • . 

users. One of the user's printers is designated a ,h; del'";; T'"' T T °^ 
P-^sherneverrLrdriir^^^^^^^^^^ 

gating the Web. '^^'P^^' documents encountered while navi- 

, "X:s':;;rzTntcrar^^^^^ ^^^^ - ^ - -ch of a 

cttcr/etaS tl^d^ntrmraT^ ^° ^"""^"'^'^ micro-transactions; 

including pr vacrde,1"e?y^r^^^^ and telephone numbers; global preferences 

containinVthe user stcod^d f^^^^^^^^ °[^--^trlc records, 

accounts, with which e-commerc'e payLt'crbe made ' ""'"^-^^ P-^-ent card 

The user's mailbox and contact list are described in Section 4. 

3.2 User Registration User Interface 

3.2.1 Help Page 

The help page contains the following buttons which generate registration forms: 

• add user 

• add pen to user 

• add pen to local user 

• authorize user on printer 

• authorize global user on printer 

• authorize terminal on printer 

3.2.2 User Registration 

interne, with the Nctpag. NetwS ^''"^ """8 »W« » meaningHtlly 

"h- :st:rt.^r r.:L^ttXs^^^^ -™ .0, 

"liich th. rcgist^tion taS jTace -° 'H. printer through 

A subset of the users authorized to use a nrinrpr nr*- H^cio^or^^ • 

.Key at,th„i„ the tegist.tion 7:SZ/^2T^J'J:'r^^"- 
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By default, every new user is an administrator on a particular printer until a printer-spe- 
cific privileges setting is enabled (via the help page). Thus a new user can be registered 
without having to be authorized by an administrator's pen until the privileges setting is 
enabled. This setting may never need to be enabled in a domestic environment, but may 
commonly be enabled in a corporate environment. User-specific privileges settings only 
appear on the registration form if the printer-specific privileges setting is enabled. 

When privileges are enabled, the user registration form must be authorized by an adminis- 
trator's pen. This is done by initialling the registration form in the appropriate place. 

The user registration user interface flow is illustrated in Figure 9. 




Figure 9. User registration user interface flow 
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Netpage User 
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Figure 10. User registration page 
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3.2.3 Pen Registration 

Additional Netpage Pens may be linked to existing users. 

The <add pen to user> button on the help page generates an pen registration forni (Figure 
12). The form contains name and nickname fields and a <submit> button. If the form is 
requested using the new pen, i.e. the pen to be registered, then the form is blank and must 
be filled in with sufficient name details to identity the user If the form is requested using 
an existing pen, then the form is automatically filled in with the details of the existing 
pen*s owner. 



submit 
(unknown user) 




Figure 11. Pen registration user interface flow 

When the form is submitted, the name information is matched against the list of local 
users, i.e. users authorized to use the printer. Partial name information can be entered, such 
as just a first name or a nickname. If the name information is ambiguous, the system gen- 
erates a list of matching users (Figure 13) with an <add pen> button next to each. 

The user must submit the pen registration form using the new pen. This links the new pen 
to the user. The form cannot be submitted using a pen which is already registered. 
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only iti!;:c::zzjiT' ^" "^-^ -^'^^ - is 

t'l^^Twf-^'?'^^^ ^^Sisf^tion fonn must be authorized by an adminis- 

trator s pen. This ,s done by .n.t.allmg the registration form in the appropriate place 

The pen registration user interface flow is illustrated in Figure 1 1 . 
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Figure 12, Pen registration page 
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Figure 13. Pen registration - matching users page 
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Add Pen to Netpaae Ueer 
Local Ueer Liet 
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add pen "^ TiTeer'name = = = = = = = = = = = = = : 



Figure 14. Pen registration - local 



users page 
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3.2.4 Authorize User on Printer 



A user may be authorized to use additional Netpage Printers. Once authorized to use a par- 
ticular printer, the user may interact with the printer using any pen linked to the user. 

The <authorize user on printer> button on the help page generates a user authorization 
form (Figure 16). The registration form contains name and nickname fields and a <sub- 
mit> button. If the form is requested using a pen owned by a local user, then the form is 
blank and must be filled in with sufficient name details to identity the new user. If the form 
is requested using the new user's pen, then the form is automatically filled in with the 
details of the new user. 

submit 
(unknown user) 





Figure 15. User authorization user Interface flow 



When the form is submitted, the name information is matched against the global user list. 
Partial name information can be entered, such as just a first name or a nickname. If the 
name information is ambiguous, the system generates a list of matching users (Figure 17) 
with an <authorize user> button next to each. 
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^MRguli'1i;°2HT''<'"r °" ""B'Senemc a lis, of .11 u«r, on ,he „«. 

The user authorization user interface flow is illustrated in Figure 15. 




Figure 16. User authorization page 
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Authorize Netpage Ueer On Fr'mter - r 'pa^eiofl \ 
Matching Ueer Liet " ' 
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^ auth user ^ 


|i user name ^ 


( auth user ^ 


n user name ^ 
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Figure 17. User authorization - matching users page 
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"^^i^u^rF^ ^^^P^0^ Ueer on Frinter: 
Global Ueer Liet 

C ^^^^ user"^ r U3er'r\a me 

auth ueer^ t ueer'name = = = = = = = = = = r 

(^auth ueer^ ^ueer'name = = = = = = = = = zz = 

auth user ^ T ueer'name = = = = = = = = = = = = ; 

C tjser"^ ri7ser"name = = = = = = = = = = = : 

auth user ueer'name = = = = = = = i: = = r: 

([fu^h^ser^r U5er~name = = = = = = = = = = = : 

auth user"^ r user'name = = = = = = = = zz: 

C ^'^^^ user) _r user'name = = = = = = = = = = : 

a uth user"^ j" iTser'name = = = = = = = = = r: 

auth user user'name = = = = = = :zz = 

auth user ^ [user'narrie = = = = = = zz = z 

auth ueeT) \ ueer'name = = = = zzzzzz 

(^auth useT^ ruser'name = = = = = = zzzzz 

(^auth user"^ ri7ser"name = = = = = = = = zzzz 

auth user ^ ruser'name = = = = zzzzz 

(^auth ueer^ i ueer'name = = = = = = = = =: = r = = 

auth user^ user name 

C ^^^^ user^ Tuser name zzzzzzzz 

auth user^ Tuser'name = = = = = = = zzzz 

auth user"^ ruser"name = = = = = = zzzzz 

auth U5gr^ ruser'"narne = = = zz = zzzz: 

auth user"^ r user'name = = = = = = = = zzz: 



Figure 18. User authorization - global users page 



Confidential 



20 October 1999 



20 



Silverbrook Research 



Netpage Applications 



draft vO.2 



3.2.5 



Authorize Terminal on Printer 



The <authori2e terminal on printer> button on the help page produces a terminal authori- 
zation token. The token is printed with information which allows the user of the Web ter- 
minal to register the Web terminal with the Netpage Network, allowing it to print to the 
Netpage Printer identified by the token. 

An administrator may revoke a terminaPs authorization at any time. The <authorize termi- 
nal on printer> button is also only available to administrators. 




auth 
terminal 




Figure 19. Terminal authorization user interface flow 
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4 Electronic Mail 

Each Netpage user has a unique id within the Netnape <:vct^,„ • i ■ 

system by their name which mav or 11. '^f'P^ge System, and is also known to the 

E-mail is a core service of the Netpage System. 

4.1 E-MAIL Object Model 

4.1.1 E-mail User 

The e-mail user class diagram is shown in Figure 20. 



e-mail 
user 



Netpage • 
ueer ! 



internet 
user 



name 

e-mail addr 



Figure 20. E-mail user class diagram 

4.1.2 E-mail 



pat^^cluirls ^ " P^^^ corresponds to a Netpage. The 

p2ed a^^^^^^^ ^^''"^'•^^ ^^"^^ f<>-" that it fs com- 

pobea, ana it is composed by the sender page by page. 

primeSTi?;^';' f '°!r'''' '"^ ""■"^^^ of attachments. An attachment is 

printed at its point of insertion, and may overflow onto the following page(s). ^ 



Confidential 



20 October 1999 



22 



Silverbrook Research 



Netpage Applications 



draft vO.2 



The sender of the e-mai! is an e-mail user, as are any number of recipients and copy recip- 
ients (CCs). Blind copy recipients (BCCs) are not modelled here for clarity, but can obvi- 
ously be trivially accommodated. 

The e-mail has a explicit subject which is always converted from digital ink to text to sup- 
port interoperation with e-mail systems which don't directly support digital ink, such as 
e-mail systems on the Internet, and to streamline the presentation of mailbox contents 
within the Netpage System itself. 

The e-mail has a high priority flag which allows the both sender and the recipients to con- 
trol the timeliness of its delivery. 

The e-mail class diagram is shown in Figure 21. 



recipient 



I 



e-mail 
ueer 



I 



sender 



e-mail 



subject 
hi^h priority 
date & time 



I 



copy recipient 



pa^e 


* 


attachment 




content 


content 



Figure 21. E-mgtl class diagram 



4.1.3 



Mailbox 



Incoming e-mails may be accumulated in the user's mailbox, printed on the user's default 
printer, incorporated into the user's daily newspaper, or any combination of these. The 
user can select, for example, to print high-priority e-mails immediately on receipt but to 
hold low-priority e-mails. 



» Netpage » 
I user I" 



mailbox 



e-mail 
folder 



name 

delivery opts 



e-mail 



Figure 22. Mailbox class diagram 
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folder is from CO...C.S no, associated wi,h a 

OtheLkl , ' '""'^2'' '•^'^t^'' fr^-" »he e-mail folder once pr ntld 

diSStheT;!:""'" '"^^ unti3„Sfy 

The mailbox class diagram is shown in Figure 22. 
4.1.4 Contact List 

Z t 71 f printed paie' TT,e conic, ,i , a?: p^JJ^Tl 

A user may create any number of contact groups within the contact list and treat a ero„n 

The contact hst class diagram is shown in Figure 23. 





contact 


user J 


list 



contact 



e-mail 
folder 



contact 
^roup 



name 



user 
contact 



e-mail 
user 



Figure 23. Contact list class diagram 
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4.1 .5 Barred User List 

Rather than accepting e-mail only from known contacts, a user may choose to bar individ- 
ual users. The barred user list records individuals from which the user refuses to accept 
e-mail. 

The barred user list class diagram is shown in Figure 24. 





barred user 


user ] 


list 




.? 




barred user 




name 



e-mail 
user 



Figure 24. Barred user list class diagram 



4.2 E-MAIL User Interface 

4.2.1 Send E-mail 

E-mail is sent using the outgoing e-mail form (see Figures 27 and 28). The e-mail form is 
always printed with the sender's name already specified, since the sender's identity is 
known from the pen used to request the e-mail form. If the e-mail form is requested by 
pressing a user-specific <e-mail> button on some page, then the e-mail form is printed 
with the recipient's name already specified. On the other hand, if the e-mail form is 
requested from the help page, then the recipient is unknown and is left blank on the form. 
The user must specify at least one recipient before the e-mail can be sent. 

The user can also pre-address an e-mail form by pressing the <e-mail to contacts> button 
on the help page. This elicits an add recipients form (Figure 29), which lists the user's 
contacts. Each contact has a <To> and a <CC> checkbox as well as an <e-mail> button. 
The e-mail button elicits an e-mail form addressed to that user. The <e-mail selected> but- 
ton at the bottom of the page elicits an e-mail addressed to all the users whose <To> or 
<CC> checkboxes have been checked. 

The e-mail form initially consists of a double-sided page. The front (Figure 27) contains 
fields for the names of recipients and copy recipients, for the subject, and for the body of 
the e-mail. The back (Figure 28) contains a field for continuing the body of the e-mail. 
Any recipient names (or addresses) written by hand are converted from digital ink to text 
for lookup purposes. The subject is also converted, for presentation purposes, as discussed 
earlier. The body is retained as digital ink, to allow handwritten text and diagrams etc. to 
be delivered in a uniform and expressive manner. 

The <add page> button at the bottom of every page of the e-mail form adds another dou- 
ble-sided page to the e-mail form. Only the additional page is printed, not the entire form. 
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£V idesX H r'^/r r^?' ^corresponding page from the e-mail (but not 
rVmoved a^H J K '"'"^ ^«P'i"'«d with the discarded page 

r^Te r4t:rv:.7n^^^^^^^^ -^^^^^ - --^ - 

Snie an e mairh. u " "T"' ^^'^ ^"'^ '""^ P""'^'' ^» '^P «ver, page 

edited and sent ^^^^^^^^ "'^^ ^ "^^P^' ' easily made.' 

anotheV coov of thli . f """'"^ °" "^^"^ P^^^ ^"^^ f"™ Pnnt 

— Bo-heorU 



e-mail 


[ 


contacts 


help 








Figure 25. E-mail user interface flow 



Text in the <recipients>, <copy recipients> and <subject> can be struck out wifh th. 
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Additional pages are automatically added to the e-mail to accommodate the attachment. 
The attachment can consist of anything which can be selected on any Netpage. 

The <add recipients> button adjacent to the <recipients> and <copy recipients> fields at 
the top of the first page of the e-mail form elicits an add recipients form (Figure 29), with 
the <subject> field reflecting the subject of the e-mail form. The <e-mail> and <e-mail 
selected> buttons on the add recipients form elicits a copy of the e-mail form with the 
additional recipients and copy recipients added. 

The <send> button at the bottom of every page sends the entire e-mail. If the name of any 
recipient is unknown to the system, then the e-mail form is reprinted with the offending 
name printed in red, together with an error message indicating the problem. 

If the name of any recipient is ambiguous, then a list of matching users is printed, each 
with a checkbox allowing it to be selected. The <e-mail> button at the bottom of the form 
reprints the e-mail form with the recipient names suitably updated. 



send 

(unknown recipient(s)) 



e-mail 




send 
. (ambiguous 
\ recipient(s)) 


matching 
user 
list 




r e-mail 


1 1 



Figure 26. E-mail recipient exception user interface flow 

The overall e-mail user interface flow is illustrated in Figure 25. The e-mail recipient 
exception user interface flow is illustrated in Figure 26. 
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[ ^ifJl^Afrom eender iVtime & date 




Figure 27. Outgoing e-mail first page 
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I E-mail from eender to recipient 0t time & date " ^ T page # £?f # 1 

— — — — — — — — — — — — — — — — — — — — — — — — — — — — — — -.J 



• 


line color palette 




line width palette 





e-mail body 



^ attach add pa^e d\ecard pa^e ^ 



Q send ^ 



Figure 28. Outgoing e-mail second or subsequent page 
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Figure 29. Add recipients page 
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4.2.2 Receive E-mail 

E-mail is received in the form of an incoming e-mail document (Figures 30 and 31), 
which has the same page structure and content as the corresponding outgoing e-mail form. 

The <reply> button at the bottom of every page of the e-mail document produces an out- 
going e-mail form (Figures 27 and 28) addressed to the sender of the incoming e-mail, and 
with the subject reflecting the subject of the incoming e-mail, but with "In reply to:" added 
as a prefix. 

The <rep!y to all> button produces an outgoing e-mail form addressed to the sender of the 
incoming e-mail, as well as to all of its recipients and copy recipients. 

The <forward> button produces an outgoing e-mail form with no recipient, and with the 
subject reflecting the subject of the incoming e-mail, but with "Forwarded:" added as a 
prefix. The body of the incoming e-mail is also copied to the body of the outgoing e-mail. 

The <forward to contacts> creates, but doesn't print, an outgoing e-mail in the same way 
as the <forward> button, and then implicitly invokes the <add recipients> command on it. 
This elicits an add recipients form in the usual way (Figure 29), with the <subject> field 
reflecting the subject of the forwarded e-mail. 

The <add to contacts> button adds the sender to the recipient's list of contacts and pro- 
duces an edit contacts form reflecting the updated contact list. Contact list editing is 
described in more detail in Section 4.2.3 on page 34. 

The <bar> button adds the sender to the recipient's list of barred users and produces an 
edit barred users form reflecting the updated barred user list. Barred user list editing is 
described in more detail in Section 4.2.5 on page 43. 
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Figure 30. Incoming e-mail first page 
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r E-m^il for recipient from sender' Ji time"& date 1 T paaefof^ 1 

— — — — — — — — — — — — — — — — — — — — — — — — J — _j 

r — — — — — — — — — — — — _-____.-__ — — 

e-mail body " 
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Q reply reply to all ^(^ forward ^ to contacts^ 



Figure 31. Incoming e-mail second or subsequent page 
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4.2.3 Edit Contact List 

^^^^^^^^ 

■ *t%tm'act nJff "'^•'^ selected contacts from 

*Lved ^ '° " ^^P""'^'' 'he deleted contacts 

seLTcZl!L7l7l^TZ "T" '""""^ '''' *e fon. allows the 

(Figure 34) '° ^ ^'""P "^"P^ 

The contact list editing user interface flow is illustrated in Figure 32. 
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Figure 32. Edit contact [listgroup] user interface flow 
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Figure 33. Edit contacts page 

The copy (move) contacts form lists all of the groups in the user's contact list, each with a 
<copy to> (<move to>) button which copies (moves) the selected contacts to the specified 
group. When a <copy to> (<move to>) button is pressed, an edit contacts form is printed 
which shows the updated membership of the destination group. 
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The copy (move) contacts form provides a <new erouo nam**> h^m %u • . 

<conv to neu/> /'<'«,^w^ *^ L ^. . ^ ^ name> field with an associated 
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Figure 34. Copy contacts first page 

The set e-mail folder form lists all of the folders in the user's mailbox each with a <set> 
button which sets the folder as the contact's e-mail folder. When the 2e^ button s 
^ ' ""^"^ '^"^ ''^ ^^-^^^"^^ folder tsociated^^^^^^^^^^^^ 
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The set e-mail folder form provides a <new e-mail folder name> field with an associated 
<set new> button. This allows a new folder to be simultaneously created and selected as 
the contact's e-mail folder. The new folder has an associated set of checkboxes which 
allow the folder's e-mail delivery options to be specified. 
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Figure 35. Set e-mail folder first page 
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4.2.4 List Mailbox 



each With a set ofThSxefwhJ'h refl^^^^^^^^^ f;'!^ "^^'"'^ ^"•'^-s. 

the delivery options to be chano^H fI^kTm ^^''^^ry options and allow 

foldl fo™ (nSiitsJ" °f fl*' Via ,he e-.,i, 

The mailbox listing user interface flow is illusltated in Figure 36. 
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Figure 36. List mailbox user interface flow 
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Figure 37. Mailbox page 

Where an e-mail is a reply to another e-mail, the subject of the replying e-mail is indented 
relative to the subject of the e-mail to which it is replying. Thus each thread of a discus- 
sion is clearly visible. Entries for e-mails which have never been printed are printed in 
bold to draw the user's attention. 
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Each e-mail entry has a checkbox which allows if tr^u . 

which allows the entire e-mail to be printed n^L fo^^^^^^^ V.T 
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Figure 38. E-mail folder page 
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The <copy selecied> and <move selected> buttons at the bottom of the e-mail folder form 
allow the currently selected e-mails to be copied or moved to a different e-mail folder via 
the copy e-mail form (Figure 39). 
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Figure 39. Copy e-mail first page 

The copy (move) e-mail form lists all of the folders in the user's mailbox, each with a 
<copy to> (<move to>) button which copies (moves) the selected e-mails to the specified 
folder. When a <copy to> (<move to>) button is pressed, an e-mail folder fomi is printed 
which shows the updated contents of the destination folder. 
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4.2.5 Edit Barred User List 

The barred user list is edited via the edit barred users form (Figure 41). The form is 
obtained by pressing the <edit barred user list> button on the help page. It is also printed 
whenever a user is barred, for example when the <bar> button is pressed on an incoming 
e-mail to add the sender to the barred user list. 



The form lists all of the users in the user's barred user list. Each has a checkbox which 
allows it to be selected. 

The <unbar selected> button at the bottom of the form deletes the selected users from the 
barred user list. The form is re-printed with the deleted users removed. When a user is 
deleted from the list that user is no longer barred. 

The barred user editing user interface flow is illustrated in Figure 40. 




Figure 40. Edit barred user list user interface flow 
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Figure 41. Edit barred users page 
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4.2.6 Global User Directory 

The global user directory, since it is large, is navigated via a directory index (as described 
in Section 2 on page 6). It is obtained by pressing the <global user directory> button on 
the help page. 

The global user directory page (Figure 43) contains an alphabetical list, by family name, 
of users in the name range covered by the page. Each entry has three associated buttons. 
The <info> button produces a user information page (Figure 44), the <e-mail> button 
generates an outgoing e-mail form (Figures 27 and 28) addressed to the corresponding 
user, and the <add to contacts> button adds the user to the user's contact list and prints the 
updated contact list (Figure 33). 

The global user directory page also contains the standard index navigation buttons. 

The global user directory user interface flow is illustrated in Figure 42. The index user 
interface flow and associated page layouts are as.described in Section 2 on page 6. 




Figure 42. Global user directory user interface flow 

The user information page (Figure 44) contains the user's contact details as provided dur- 
ing user registration, subject to the user's privacy preferences. It also contains <e-mail> 
and <add to contacts> buttons which work in the usual way. 

The <Intemet e-mail address> is only included if the user information page is printed via 
the contact list for an Internet contact (as opposed to a Netpage contact). 
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Figure 43. Global user directory page 
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Figure 44. User information page 
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4.2.7 Business Card 



com2 del , f^^ (F'gure 46) serves a dual purpose. While it conveys the user's 
contact details in the usual way, it also acts as an e-mail authorization token X^^n V 
recipient of the card presses the <add to contacts> button on the card the own^.r ^ 
card .s added to the recipient's contact list in the usual way, but the rectpient h als; add 5 
ho^.d?H""' ! '""'^'^ the recipient to s^nd e ITl rtJl ca^rowt 

Strb^aS^ 

The business card user interface flow is illustrated in Figure 45. 
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Figure 45. Business card user interface flow 



r — — — 



c 


e-mail 


) 


c 


add to 
contacte 


) 



. [title] _[fir5j;ji^m_eHi^^ nam^f " 

1^ [street addreee]] 
1^ [street addrees'Z] 

[[f 'fy] [ptate"] [ZlF'Code] 

I [country] 

I [i^Z't. Pj^Z"^' ^^'""•^ phone"nurr^ber] 
1^ [moUjIe^phone: mobile phone number] 
1^ [home phone: home phone number] 



Figure 46. Business card 
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Zon^l h ? '° '"'""^ ""^'""^ """'^'^^ ''^'^"^ »° '"^'"''^ the business card, an 

m^n^H L ^""^ ''^^ ^«q"'^ed. Once the request is sub- 

"^^f"'°"'^''^^"y P""'e<l by the bureau, delivered by mail to the user's 
address, and the small cost chaiged to the user's Netpage account 
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The business card request user interface flow is illustrated in Figure 47. 
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Figure 47. Business card request user interface flow 
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Figure 48. Business card request page 
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4.2.8 Add Internet Contact 

An Internet e-mail user can be added to a user's contact list using the Internet contact 
registration form (Figure 50). Since an Internet user is not otherwise known to the 
Netpage System, the form allows full name details to be specified, in addition to the Inter- 
net user's e-mail address. 

The Internet contact registration user interface flow is illustrated in Figure 49. 




Figure 49. Internet contact registration user interface flow 
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Figure 50. Internet contact registration page 
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5 Purchasing 



The Netpage System provides efficient mechanisms for merchants to offer goods and ser- 
vices to customers, and for customers to select and pay for those goods and services. 

A customer can order directly from a catalog browsed and printed dynamically via 
Netpage, as well as from a pre-printed catalog delivered by traditional means. 

The customer's dynamic signature, in combination with the customer's uniquely identified 
pen, authenticates the purchasing transaction in a way which is impossible to forge. If the 
customer chooses to use the Secure Electronic Transaction (SET) payment mechanism 
built into the Netpage System, then the customer's payment card details are never revealed 
to the merchant, ensuring that card details can neither be accidentally nor maliciously 
compromised. 

The purchasing mechanisms described in this section are generic, and apply to the pur- 
chasing of myriad kinds of goods and services. 



The purchasing object model revolves around merchants and customers. 

Each merchant has a globally unique identifier, as well as a name and other details. Each 
customer is related to a particular merchant, and has an identifier which is unique within 
the scope of the particular merchant. Each customer represents a particular Netpage user 
to the merchant, A Netpage user, on the other hand, can be the customer of any number of 
merchants- 
Each merchant offers a range of products for sale, typically presented in the form of an 
organized catalog. Any Netpage user can browse the merchant's catalog, but the user must 
become an explicit customer of the merchant before being able to complete an order with 
the merchant. 



5.1 



Purchasing Object Model 
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Jh^wnln'^Figure 52 '''^"'^ ^^'^^ '^"^ customer class diagram is 
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Figure 51. Merchant class diagram 

NetpagH^^^^ description of a customer derives from the details of the corresponding 

fh^nVTr''"'^' ^ P^^"'^"' '"''^^^^ ^h*PP»"S addresses with the mer- 

chant. The most recent of each is recorded and used as the default on any new order. 

Each customer has an account with the merchant which records the net balance of all 
invoices and received payments. Account payments, i.e. payments not associated with a 
particular invoice, are associated directly with the customer account 
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Figure 52. Customer class diagram 
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Each customer has a history of orders, each in a particular state of completion as reflected 
by its status. The order class diagram is shown in Figure . 

Each order is uniquely identified within the scope of the merchant. 

Each order has a status which indicates whether the order is pending (i.e. not yet submit- 
ted), active, partially or fully shipped, cancelled or completed. An order is not completed 
until full payment is received. 

Each order consists of a number of order items, each of which specifies the quantity of a 
particular product offered by the merchant. Each order item also includes a backorder 
quantity and a quantity shipped. The backorder quantity is used to register a claim on 
future stock when there is insufficient current stock to fully satisfy the order item. The 
quantity shipped is used to record the cumulative quantity actually shipped. 

Each order is associated with a. particular payment method, shipping address, and shipping 
method. 
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Figure 53. Order class diagram 

The most common of the many possible payment methods are shown in the payment 
method class diagram in Figure 54. The set of payment methods supported by a particular 
merchant will be specific to that merchant, and may be different for different customers of 
the merchant depending on their credit ratings etc. 
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When the Netpage account payment method is used, the user's Netpage account is deb- 
ited, and the transaction appears on the user's Netpage account statement. 

When the customer account payment method is used, the user's customer account is deb- 
ited, and the user is invoiced for payment. 

When the pro forma invoice payment method is used, a pro forma invoice is issued 
requestmg pre-payment of the order. When payment is received, the goods are shipped. 

When the cash on delivery payment method is used, payment is expected when the goods 
are delivered. e 

When the SET payment card payment method is used, the corresponding SET payment 
card Imked to the user is used to make payment according to the normal SET protocol. 

When the payment card payment method is used, the specified payment card is used to 
make payment according to the normal protocol between the merchant and their acquiring 
bank or mstitution which handles the particular payment card type. 

Invoice and pro forma invoice payments are normally made with a check or money order 
Cash on dehvery payments are normally made with a check or cash. 
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Figure 54. Payment method class diagram 

The set of shipping methods which applies to a particular order depends on whether the 
order's shipping address is domestic or international with respect to the location of the 
merchant's warehouse. Typical domestic shipping methods include standard shipping, sec- 
ond day air, and next day air. Typical international shipping methods include standard 
shipping, airmail, and international priority. 
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The most common shipping methods are shown in the shipping method class diagram in 
Figure 55. 
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Figure 55. Shipping method class diagram 
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5.2 Purchasing User Interface 



Quantity increases are subject to availability and payment approval. 
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The overall purchasing user interface flow is illustrated in Figure 56. 



5.2.1 



Locate Merchant 



A merchant can be located by browsing or searching the global Netpage directory or the 
user's own bookmarks. A merchant may also be encountered in the form of an advertise- 
ment in a Netpage publication. Both a directory entry and an advertisement typically link 
to the merchant's main page. This in turn links to the merchant's product catalog. If the 
user already has a copy of the merchant's main page from a previous encounter, then the 
catalog is immediately available. 



A small product catalog is typically organized into a set of categories. The main catalog 
page simply lists the categories, and each category page lists all of the products in the cat- 
egory. This is indicated in the user interface flow in Figure 56. 

If the product catalog is large, then it may still be organized into categories, but it may be 
impractical to print the entire contents of a category when a user wishes to browse the cat- 
egory. Instead the directory navigation techniques described in Section 2 can be used. A 
catalog search will often be specific to the kinds of products represented in the catalog. 



Many applications involve the user maintaining a collection of items. In the screen-based 
version of the application, the user's collection is typically shown every time an item is 
added or removed. The user therefore receives immediate feedback when the collection 
changes. The collection may reflect an e-mail recipient list, a shopping cart, etc. 

In the Netpage version of the application, it is less practical to re-print the collection every 
time it changes. Item deletions and quantity changes can be marked up visibly, and so do 
not necessarily require immediate re-printing. Item insertions, however, are more prob- 
lematic. In some cases the entire source list can be used as the input form, allowing it to be 
marked up visibly. This may be particularly apt if the source list already represents a 
user-specific subset of the complete source list, e.g. last week's shopping list rather than 
the grocery store's complete range. There will be cases, however, where the user will pri- 
marily be making selections from a complete catalog. The catalog may even be many hun- 
dreds of pages long, offset printed, and delivered in the mail. Since it is intended for 
multiple use, it is not suitable for visible markup. 

One way to order via a large catalog is to print intemiediate product-specific pages. Each 
catalog entry has both an <info> and an <buy> button. The <info> button elicits a 
full-page description of the product with a quantity field which, if filled in, adds the prod- 
uct to the shopping cart aw^/ provides a visible record of the item order. This avoids having 
to print the contents of the shopping cart every time an item is added to it. The <buy> but- 
ton elicits a similar full-page description of the product but automatically adds it to the 
shopping cart. It contains a quantity field, already filled in with the quantity ordered by 
default, which can be used to vary the quantity ordered. 

Depending on the nature of the order, it may be practical to also list the contents of the 
shopping cart on the product-specific page. However, it is the fact that the product page 
gives product-specific information that is of primary value to the user. 



5.2.2 



Browse Catalog 



5.2.3 



Order Item 
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The product page is visibly linked to the order itself because it is tagged with the name of 
the current user, the order transaction number, and the order date and time. 



5.2.4 Complete Order 



The shoppmg cart represents the contents of the current order. The shopping cart is acces- 
sible from any merchant page, whether the page is part of the current order form or not 
The shoppmg cart provides a convenient place to review the order and make fmal changes. 

The checkout is also accessible from any merchant page. It provides a place to specify 
shipping and payment information, and finally to confirm the order 

The checkout form is broken up into five sections: shipping address, shipping method, 
payment method, order items, and order confirmation. Sections have default selections 
based on the user's most recent behavior. 

The order confirmation section summarizes the order and captures the user's signature. It 
shows the current shipping address, shipping method, payment method, and order total. 

Any change the user makes to the order on the checkout form is reflected on the form, 
since the change is made with the inking pen. It is not reflected, however, in the order 
summary in the order confirmation section. To produce a consistent checkout form, the 
user can simply press the <update> button at the bottom of the form af^er making a num- 
ber of changes. An updated checkout form is immediately printed. 

The <submit> button, when pressed, submits the order. Any handwritten change to any 
Item information page, shopping cart page, or checkout page which is part of the order 
form is automatically interpreted and applied to the order. The order receipt, printed in 
response to the order submission, reflects the actual contents of the order. 

The checkout form consists of a header (Figure 57), a section for selecting a previously 
used shipping address or specifying a new address (Figure 58), a section for selecting a 
shipping method (Figure 59), a section for selecting a previously used payment method or 
specifying a new payment card (Figure 60), a section for reviewing the list of order items 
and making last-minute changes (Figure 61), a section for signing the order to confirm 
payment (Figure 62), and a footer which contains the <update> and <submit> buttons 
(Figure 63). 

The printed checkout form will vary in length depending on the number of previously 
used shipping addresses and payment cards, and the number of items in the order. In many 
cases it will fit conveniently on two pages printed on a single sheet of paper. 

The order receipt lists the items ordered and summarizes the order parameters in much the 
same way as the order confirmation section of the checkout form (Figure 62). 



Checkout [ S*^p<^'"order#, customer? ti^ date' " " 1 T p^^e Sofi 



Figure 57. Checkout page header 
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(1) Shipping Addreee 

I shipping address 
I shipping address 



New Shipping Address 
Name 



contact r\ame 



St^reet 
Address 



street address 1 



I street address 2 



City I city 

State 
Country 



I state I Z\F Code | ZIP Code 



country 



Fhone [ contact phone number 




Figure 58. Checkout page shipping address 



(2) Shipping Method 

Pomes tic 

Standard shipping 
Ql Second day air 

Next day air 



International 

Standard shipping 
Airmail 

International priority 




Figure 59. Checkout page shipping method 



Confidential 



20 October 1999 



61 



Silverbrook Research 



Netpage Applications 



draft vO.2 




(3) Payment Method 



nt 



payment card Tiarne&'accou 

Qj [Pfy^^^t card name'sTaccount 
Ql Account 

F'ro forma invoice 

Caeh on delivery 

New Fayment Card 
Name 

Account 

Expiry 



J expiry . fxpiry_d^te j | new expiry 
J expiry \^e^p^'£ate\ | new expiry 




payment card account 

□ 

Viea 



expiry date 



□ □ □ 

MasterCard American Oiecover 
Express 



Q 

JC3 




Figure 60. Checkout page payment method 




(4) Iteme 



quantity 



1^ item deechption 

r — — — — — 

1^ item description 

^. — 

1^ item description 



price 



total 




price 



c^uantity || i 
l^uantit^J r 




Figure 61. Checkout page item list 
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(5) Confirm Order 



5ut?total 
Tax 

Freight 
Total 

Ship to 



3y 



I subtotal 
k. — _ _ _ 

r — — — — — 

I tax 

fc. 

r — — — — — 

I freight 

r — — — — — 

I total 



I contact name, street addreee 1. street address 2, 

[ city, state* ZIP Code, country, contact phone number 

I 
I 
I 



I shipping method 



Charge to i payment method 



Signature 
required 



signature 



Figure 62. Checkout page order confirmation 



( update ^( submit ^ 



Figure 63. Checkout page footer 



5.2.5 



Edit Account 



Users can edit their customer details maintained by the merchant, including their list of 
shipping addresses and their list of payment methods. They can also print their order list. 
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and details of individual orders. They can edit any order which has not been fully shipped 

as described earlier. pk^^j 

Jach fJ"'' ''TJ°' """^ ^'■"^'"g button associated with 

hem rtTf f ^"Py °f .'he order receipt, but with an updated status for each order 
tem. The status of an order item denves from the status of the order it is part, as well as 
the presence of shipment items and backorder items associated with the order item. 

5.2.6 Edit Order 

The order receipt allows the quantities of individual order items which are still active to be 
altered. Once alterations are made, the user must press the <submit> button. An updated 
receipt is produced. 

To edit order parameters, the user can press the <edit> button on the order receipt This 
produces an order editing form which is similar in structure to the checkout form Once 
ducS'°"^ ^'^ "^^^ """^^ <submit> button. An updated receipt is pro- 

5.2.7 Receive Shipment 

The shipment is accompanied by payment receipt, or, if the payment method is "cash on 
dehvery an mvo.ce which allows the user to pay the delivery person by traditional means 
(e.g. cash, check, or payment card not processed through Netpage), or using a Netpage 

LTiT'"''! . '''"P'y '""'■•^'"S the appropriate payment method 

and signing the form with a Netpage pen. 

A customer can therefore defer authorizing payment until the goods are delivered, even 
when using a payment method which allows the Netpage System to obtain immediate 
online payment authorization. Conversely, the delivery person can verify payment before 
handing over the goods. 



Confidential 



20 October 1999 



64 



Silverbrook Research 



Netpage Applications 



draftvO.2 



6 Folder Hierarchy 



6.1 Folder Hierarchy 



There are several instances where a Netpage user is able to organize a set of items into a 
hierarchy of folders. Examples include the user's contact list, favorites list, etc. 



In each case the folder hierarchy consists of a root folder containing any number of folder 
entries. Each folder entry is either itself a folder containing further folder entries, or is a 
link to an actual folder item. 



Folder entries may in general be members of more than one folder, although particular 
applications may not allow this. Both folders and folder items are typically named, and a 
folder is often presented to a user sorted by name, although sorting by other attributes can, 
of course, be equally valid. 

When a folder item has an efficiently-retrievable name, and the folder is required to reflect 
the most up-to-date version of the name, then the folder item link is typically not named, 
and the name is instead retrieved from the folder item itself when required. 

Each folder hierarchy is maintained by the Netpage Registration Server on the user's 
behalf, as part of the user information maintained by the server 



The folder hierarchy class diagram is shown in Figure 64. 
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Figure 64. Folder hierarchy class diagram 
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7 Navigation Aids 



7.1 Favorites List 



Each Netpage user is allowed to maintain a list of "favorites" - links to useful documents 
n .e th^i / T T maintained by the server. The user can orga- 

The favorites list class diagram is shown in Figure 65. 

r , 

j Netpage j 



favorites 
list 



favorite 



T 



1 






favorites 
folder 




favorite 
document 


name 


name 



j Netpage ' 
, document [ 



Figure 65. Favorites list class diagram 

Mrt"'<rHH ^^^^f ''^^^ adding a favorite to the 

e^c?a l^i f documents <add selected page>, and <add selected ifnio. The user can 
the three SLnfTfJn f "'"f^""'^ ^'^^^"'"^cription) and then press one of 

rll !^ ^ ^'^'^ document> button adds a linic to the document which 

<add ."^ - -J^d page. The <add selected page> adds a link to the selected page T^e 
<add selected l,nk> button adds the first hyperlink contained in the current selection Thi! 
allows a document to be added to the favorites list without printing that docurnenl 

1?!"^ T "f ^"^"^^u ''^ "'^ °' ^ 'P^"^"' folder depend- 

nortion ^•'"'''"^;^P^f 'he button is pressed on contains a portion of the root list or a 

rZZZ ^^'"^' "^"^ ''"'P P^Se also contains the three buttons for adding 

a favorite. These buttons always operate on the root list. 

Each time a favorite is added a single double-sided page is printed showing the part of the 
list containing the new favorite. 

Each entjy in the favorites list is labelled with the name of the document. If the link is to 
an individual page, then the page number of that page is also shown. 
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If the user attempts to add a hyperlink which only makes sense in the context of its origi- 
nal location (e.g. a <submit> button on a form), then the operation is rejected with an 
appropriate error report. 



7.2 History List 

The Netpage Registration Server maintains a history list on each user's behalf, as part of 
the user information maintained by the server. The history list contains links to all docu- 
ments accessed by the user through the Netpage System. The user can navigate the list by 
date and time, search the list by document name, delete entries from the list, and disable 
the server from maintaining the list. 



The history list class diagram is shown in Figure 65. 




' Netpage ' 
[ document [ 



Figure 66. History list class diagram 
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8 Drawing and Painting 

bmsh ete^ ThJ h'^ ^ " """^ ''^ "'^ ^""^^"^ ""^ode" (i.e. color pen 

rent mode. However, there is no histoiy of mode changes on the page itself 



8.1 Lasso 
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9 Viewing 3D Objects 

When an application prints a view of a three-dimensional object on a Netpage, a number 
of controls can be provided to allow the user to change the view of the object. A set of 
controls is printed next to the image of the 3D object, and the user marks the controls and 
presses the <reprint> button to obtain a copy of the page containing the updated view. 

The 3D object is projected to 2D according to a set of viewing parameters. These are nor- 
mally defined in terms of a virtual camera, and typically include the following: 

• view point, i.e. the point in 3D at which the camera is looking 

• camera position, i.e. the point in 3D where the camera is located 

• camera twist, i.e. the rotation of the camera about the viewing vector 

• view plane distance, i.e. the distance from the camera position along 
- the viewing vector to the plane onto which the 3D scene is projected 

• view plane window, i.e. the 2D window on the view plane to which 
the scene is clipped 

• projection type, i.e. parallel, perspective, etc. 

The camera position is sometimes specified using intuitive parameters such as pan and tilt, 
where pan rotates the camera about the view point in the x-y plane, and tilt rotates the 
camera position about the view point in a plane which contains the camera position and 
the view point and is perpendicular to the x-y plane. 

The 2D projected image of the 3D scene can also be subject to 2D viewing parameters, 
such as translation and scale, within the view plane window. 

3D viewpoint controls can be implemented in many ways, including the following: 

• viewing direction: a sphere surrounds a small copy of the object, with pan and tilt rings 
marked on the surface of the sphere (see Figure 67); the user specifies a new viewing 
direction by marking a new pan and/or tilt on the rings; the current pan and tilt settings 
are indicated on the rings, and the current viewing direction is indicated by a point on 
the surface of the sphere; the object can either be shown from a standard viewing 
direction or the current viwing direction. 

• viewing direction: a small copy of the object is presented from opposite sides, with a 
transparent shaded hemisphere surrounding each copy; the user specifies a new view- 
ing direction by marking a point on either hemisphere. 

• 2D translation and scale: the user circles an area of interest; the center of the circle 
specifies the translation, and the bounding box specifies the scale. 

• camera position: a camera icon is shown in the position of the camera in the view of 
the object; the user specifies a new camera position by drawing a pen stroke from the 
camera icon to the desired position; the camera keeps pointing at the view point. 

• camera twist: a handle is attached to the camera icon; the user specifies a new camera 
twist by drawing a pen stroke from the handle to the desired position. 

• automatically suggested views: the object is shown in multiple automatically-gener- 
ated views (e.g. left, right, top, bottom, and back views relative to the current camera 
parameters); the user simply selects one of the views. 
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current 




tilt control 



Figure 67. 3D view control 



Viewing parameters can also be specified via virtual sliders and numeric input. However 
these forms of input are less intutitive and less user friendly, and so are more suited to pro- 
ressional applications where accuracy may be required. 

Previously printed pages show a history of views. Unlike screen-based 3D navigation sys- 
tems, the user cannot get lost because previous views of the scene are always available 
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Authoring 



Confidential 



20 October 1999 



71 



Silverbrook Research 



Netpage Applications 



draft vO.2 



10 Authoring Transition 
Strategies 



10.1 Overview 



eva ufrino r ^ stages of Netpage Network deployment, publishers and merchants will be 
evaluatmg the costs and benefits of participating. In order to encourage such participation 
and grow the network, it is important to lower as far as possible any barriers to ent^^ 

protocols, servers and network infrastructure will be in place from 
the start, ,t w.ll take time to develop generic high-level support for publishing, advertising 
and commerce. Early entrants may therefore be faced with significant development costs 

Wnrir^ i°.!i?u^^'^ P™*""" '° '^^^"^Se development efforts occurring in the 
S^Te wit^l r ""''"'^^ ^'^^-""^ " P""' -hich is highly fompat- 

mlT^ Tu^fJT " ^" interactive online medium which is highly com- 

prmt-onented ed.torml content on the Web, and is also well placed to exploit Web applica- 
tions defined at a suffic.emly abstract level, as is now starting to become the norm. 

wfb'^n^f th'^"^'" 'xf ' ""I""*'^' re-purposing relationships between print media, the 

web, and the Netpage Network. 



re- purpose 
content 




re-p\jrpot>e 
content & 
applications 



re-purpoee 
content 

Figure 68. Re-purposing content and applications 

10.2 Re-purposing Editorial Content 

Print publishers have been re-purposing content for the Web in various ad hoc ways 
M^Un" f'":' ''''''' ''"^^'^ ^^^'^ have begun to emerge 

Tie 1 ""k^ " ^^^"^ ^ ^'"g'^ ^^itorial data- 

tent I Lyou^ multi-purposing is the separation of content semantics from con- 

XML is beginning to be widely used as a markup language to specify content semantics. 
Uurmg or after story creation, the journalist embeds semantic tags in the text Once 
tagged, the story can be inserted into a page composition specific to a particular medium 
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such as print or the Web, where it is laid out according to a medium-specific stylesheet 
cued to the semantic tags embedded in the text. 

Several medium-independent editing and page composition systems are now emerging. 
Each supports output to both print and the Web, and can be extended in a modular fashion 
to support other output media such as Netpage. Atex' Omnex [2], System Integrators' 
Insiight [10], and Worldweb.net's Expressroom [11,12] are notable examples. These sys- 
tems integrate multiple-media publication into the core editorial activities of the publish- 
ing staff, rather than treating non-print media as separate and incidental. 

1 0.3 Re-purposing Web Applications 

Web support for application development has improved enormously since the early days 
of raw HTTP and CGI. Application servers now provide high-performance back-end 
interfaces to database systems, transaction support with commit and rollback, and isolate 
the application user interface [1,6,7,8]. Very little of the effort involved in developing a 
modem Web application goes into Web-specific programming, and as a consequence the 
cost of re-purposing a Web application on the Netpage Network is not great. The function- 
ality of the application remains unchanged, and only the detailed user interface flow and 
individual page designs need to change. 

A number of tumkey and bureau Web commerce applications are emerging as well. iCat 
[5] is one of the better-known examples. It offers customized e-commerce hosting to any 
small company with a product catalog. By simply expanding the iCat system to treat the 
Netpage Network as an additional interface in parallel with the Web, all iCat-hosted busi- 
nesses immediately gain entry to the Netpage Network with no effort on their part. 

1 0-4 Re-purposing Web Content 

At a more mundane level, the Netpage Network provides an alternative interface to the 
Web itself, providing access to entire Web sites in printed form, with several Web pages 
printed on each physical page. Web pages are appear in printed form yet remain fully nav- 
igable. The "brochure ware" which constitutes much of the Web is often more comfort- 
ably consumed in Netpage form. 

Documents in Adobe PDF format, increasingly prevalent on the Web as companies strive 
for control over final print quality and shy away from. re-coding information in inferior 
HTML, are even better candidates for Netpage delivery. 
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1 Overview 

JJi'J^^r'"' extensions to the core Netpage architecture 
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2 Netpage Printer 

2.1 Electronic Ink Output 

Various "electronic ink" technologies are emerging, including E Ink's electronic ink [2] 
and Xerox' Gyricon electronic ink [3]. Both of these technologies involve bistable mono- 
chrome dots. They can be addressed externally, e.g. by passing them through a "printer", 
or internally, by including addressing circuitry for each dot. There are several advantages 
to electronic ink. It has a display quality approaching that of ink on paper, since it is reflec- 
tive rather than emissive or transmissive. It can be rewritten any number of times, just like 
a normal computer display, and arguably at fast enough rates to allow animation. And it is 
inexpensive enough be bound into multi-sheet books, giving multi-sheet navigability just 
like paper books. In the short term it may only be practical to address it externally, and 
thus its main advantage may only be that it is easily reusable. 

A reusable electronic ink page can be made Netpage addressable. Once "printed" onto an 
electronic ink page, that page can have all the functionality of a normal Netpage. What is 
required, however, is to introduce a level of indirection between the Netpage page id and 
the logical page, since the "content" of the physical page can change. Thus whenever the 
page is referenced by the pen, the tags are translated to the page id of the current Netpage 
displayed on the electronic ink page. 



2.2 Braille Output 

A Netpage Printer can optionally contain a stamping mechanism for imprinting Braille 
characters on paper The printer can thus produce an interactive Netpage which also con- 
tains the textual content of the page encoded in Braille. Documents delivered to the printer 
are personalized for the user in the usual way so that the text size and font match a useful 
Braille character size. Each sheet of paper is printed on one side only. Graphic elements on 
a page, such as images and buttons which do not contain text, are tagged with text in 
Braille. A Braille Netpage functiorrs in the same way as a normal Netpage. 



2.3 Printer Embedded in Digital Television Set 

A Netpage Printer can be embedded in a digital television set and receive data from the 
Netpage Network via a digital television "datacast" channel. It can use a low-bandwidth 
mobile telephone or pager channel to send data to the network. The printer thus leverages 
the communications capability of the digital television set, and provides a compelling use 
of a datacast channel. It also provides opportunities for seamlessly linking broadcast tele- 
vision content, e.g. infortainment, with printed material, as described in Section 9.2.3 in 
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3 Netpage Pen / Sensor 

3.1 Universal Drawing Implement 

l'.nf ■'^^^•'"■'f "'"'^ '° ^ ""'^^--s^' drawing implement A 

Z I J u ™""'u" ^'^'^ '''' P^Se. The roller spins freely about the axis of 

he stylus, so that as the roller is dragged across the page, it automaticahy orients itself so 

behmd the roller. It pnnts onto the back of the roller, and the roller transfers the printed 
.mage onto the page. A small cleaning station cleans any ink off the surface of the roller 

IrZhl T ' '° P"""'"^'^ ^'^^y^ P""'^ a clean surface The 

printhead reproduces a contone color image via dithered bi-level CMY or CMYK The 
Stylus can be programmed to produce any colored, textured continuous line or paintstroke 
■ ™/ f Pnntmg .s dictated by the speed of movement of the roller relative to the page' 
This can be detemimed m several ways, e.g. from the actual rotation of the roller assum - 
ng reasonable fr.ction between the roller and the surface, or by continuously imlk^g the 
surface and detectmg movement in the same way as a second-generation optL mJuse or 
by sensing and decoding the map ofa self-mapping surface. «« mouse, or 

3.2 Output via LCD 

use^TdUnlf °' H 7""; '^"""^ optionally incorporate a LCD which can be 

used to display modal, selection, an status information: 

• mode name 

• current color/texture for drawing/painting 

• current line width for drawing 

• current brush for painting 

• first few words of current text selection 

• image fragment of current image selection 

• URI of hyperlink selection 

• pen status (power, communication with printer, etc.) 

• error messages 

I^in^•''^^i"''"''''^'^^^^'**'^'''' '^''"'""^ an additional page to be printed. It 

potentially allows meaningful feedback when working offline. 

3.3 Output via LED 

A Netpage Pen or similar sensing device can optionally incorporate an LED which can be 
used to indicate that the pen is in a mode. The LED can server as a reminder that the user 
recently selected a non-standard mode, e.g. a colored brush for painting. An on-page but- 
ton can be used to clear the current mode. H s " 

3.4 Output via Tricolor LED 

A Netpage Pen or similar sensing device can optionally incorporate three LEDs - one red 
one green, and one blue - which can be used in combination to indicate a continous-tone' 
color currently associated with the sensing device, for example a virtual pen or brush color 
when the sensing device is being used to interact with a drawing or painting application. 
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3.5 Interchangeable Nibs 

A Netpage Pen or similar sensing and marking device can optionally support interchange- 
able nibs. Nibs can have different shapes, producing different line styles, and can have dif- 
ferent colored ink supplies built in, producing different line colors. They can also produce 
different textures, depending on the composition of the nib. Each nib contains a code 
which uniquely identifies the type of the nib. The pen obtains the nib's identity code when 
the nib is attached to the pen. Any digital ink captured by the pen while the nib is attached 
is labelled with the nib's id. 

Since some nibs will produce a different effect depending on their tilt and rotation, tilt and 
rotation must be be embedded in the digital ink in such cases. Since the Netpage Pen is 
typically used in a somewhat fixed rotation, the nib rotation may be a function of how the 
nib is attached to the pen. 

The nib id embedded in the digital ink can then be used by Netpage software to label the 
digital ink with line, color and texture characteristics which mimic those of the physical 
nib. A use can also choose to map a particular nib to an arbitrary pen or brush style, for 
example an air brush. Although the strokes reproduced by the Netpage software will no 
longer match the strokes produced by the physical nib, the user is able to distinguish 
strokes of different kinds on the physical page. 

The nib id can also be used to signal the intent of the strokes produced with the nib. A par- 
ticular nib might be designated as a text editing nib, for example, used solely to mark up 
text. By dedicating a nib to a particular function, it becomes easier for the software to dis- 
ambiguate data (e.g. text) and commands (e.g. text editing commands). 

Any number of Netpage Pens registered to the same user can be semi-permanently dedi- 
cated to particular drawing styles or functions by having function-specific nibs semi-per- 
manently attached. 



3.6 Audio Output 

When a user interacts with a Netpage when out-of-range of a Netpage Printer, digital ink 
is buffered in the pen and is transmitted to and interpreted by the printer when the pen later 
comes within range of it. As a way of obtaining immediate feedback, pages can contain 
audio hyperlinks. When the user presses an audio hyperlink, the pen communicates with 
the user's mobile phone, the phone obtains the audio clip from the Netpage Network, and 
the phone plays the audio clip to the user. This assumes the pen and the phone share a 
short-range wireless technology such as Bluetooth, and that it is economical for the mobile 
phone to have an open data connection to the network such as promised by third-genera- 
tion mobile telephony. It works best if the user is using the phone in hands-free mode 
together with a w ired or wireless (Bluetooth) earphone. 

The pen can also contain its own mobile telephony module and audio output, thus elimi- 
nating the need to interface with a mobile phone. Similarly, if audio output is restricted to 
only operate when the pen is within range of a printer, then only an audio output capability 
is required, either in the printer or in the pen. 

3.7 Language Translation Output 

The Netpage System can offer an automated translation service. The user selects a word, a 
sentence, paragraph, or arbitrary block of text, and then presses a <translate> button, per- 
haps on the help page. The translation is displayed on the LCD, as described in Section 
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Alternatively, ti,e „„stofo™ is delivered by a.dio output as described la Section 3.<;. 



Confidential 



20 October 1999 



6 




Confidential 



20 October 1999 



7 



Silverbrook Research 

Netpage Extensions 

■ ~ draft vOi 

4 Silverbrook References 

[IJ Silverbrook Res=,n=h, f/e.p^ge Sys,e„ Over^le^. draft version 0.4, Ocober 1999 



Confidential 



20 October 1999 



8 



Silverforook Research 



Netpage Extensions 



draft v0.i 



5 Other References 

[2] E Ink, http: //www. eink .com 

[3] Handley, K., "All the World's a Page", 

http: / /www, ingersoll-rand.com/compair/oct_nov_97/octnovco/pag_l .htm 



Conftdenttai 



20 Octot>er 1999 



9 



™'S PAGE BUNK 



(USPTO) 



Self-Mapping Surfaces 

Design Description 

draft version 0.2, 20 October 1999 



Silverbrook Research Pty Ltd 

393 Darling Street, Balmain 

NSW 2041 Australia 

Phone: +61 2 9818 6633 

Fax: +61 2 9818 6711 

Email: info@silverbrook.com.au 

Confidential 



Silverbrook Research c;^^ 

belf-Mapptng Surfaces Design Description 

" . _ draft vO 2 



Contents 



Overview 

1 Self-Mapping Surfaces ^ 

2 Computer System User \ntertace ZZZZZZ''Z'Z ^ 
Architecture ^ 

3 Tag Tiling ^ 

4 Tag Capture 6 

Applications 

5 Digitizer 

5.1 Large-Format Digitizer "^^ 

5.2 Dynamic Handwriting Capture ""^ 

5.3 Dynamic Signature Capture. 

5.4 Registered Projection IS 

6 Situated User Interfaces ..!!....7...! 

6. 1 Device Control User Interface ^ 

6.2 User Interface on Toys 

6.3 Defect Logging 18 

7 Hybrid User Interfaces 

. 7.1 Hybrid User Interface to WebBrowser ^ 
7.2 Hybrid Userlnterface to Computer Application'.'^'.'.';.;;;;;;;;;;;:;.;;;;.; ' ""^ 

Hardware 

8 Tag Sensor 

8.1 Wearable Sensor ;.. .;;; ' 21 

References 

9 Silverbrook References 

10 Other References • 

24 



20 October 1999 



II 



Silverbrook Research 



Self-Mapping Surfaces Design Description 



draflvO.2 



Overview 



Confidfifiiiai 



20 October 1999 



Silverbrook Research . ^ 

____gf; ^^PP'ng Surfaces Oesign Description 



draft vO.2 



1 Self-Mapping Surfaces 

^s::^:^:r£^:^£^s:^:i t: t -^'^^ ----- ^ 

may be mapped sparsely or ubiquitously The map ITf;"'' 'Tr^.^'^'''- ^ ^""^^^ 
The map may be defined at any required^esolutrn fr'^ '"""y °^ '"^''^■bly- 

a local query on the mapped LL yt l tTnln^! " ^"'^'^ ^ 'hat 

map and among different maps. unamb.gous map reference both within the 

^^^^S:--^^^^^ a se,r-mapping surface, then 

sensmg device. The information thus re Lved can be ,T '"PP"^'* ''^ '^e 

Pl.ed directly to the operator of the sens n' device in rh' '"'"J "^y^' " ^^^^ ^e sup- 
graphics, either projected onto the suSe vtlln T '^-^t 
face-registered d^p ay throuoh he ODeratoVrh ^"--f^" by sur- 
normal computer screen. ,t c^n, morrgentr , ^latrr 'T''' ''''''''' °" ^ 
ated by the computer system on behalf of the on. ^ ^'^''^'^ 
action with the surface feature ''P^^^'"'- response to the operator's inter- 

Self-mapping surfaces can be categorised arrnrHin^ , u u , 
sive, i.e. whether the map actively pCic patSwh n i ^^'^ '''''' 
touch-sensitive screens and CRTs se^ bl toh/ ^ Digitizing tablets, 

self-mapping surfaces. Active maps are lo^^ ''"^P"' ^''''''y 

.hey do not yield unambiguous iZ-map rSencesTer'sr'"'" self-mapping, becaus^ 

, '"P^.^^'-^-P^^q-- an active sensing device to perform the map query. 

A surface map is encoded according to the following general principles: ' " 

• the encoding consists of a tiling of toes each of vvh.Vh » ^ 

• tags are sufficiently small so that a ^ ole , , J ' ^"^"'^^ ^"^"^"^^ '^i and posUion 
one full taa ''''ck is guaranteed to sense at least 



• using available 



: ^^^^^^^^^ 

■ s^'sX'f"" - from .he p<»i,i„„ of ,H, i„ „e 

■ 2t'S"„7:L": '"Tr-"'"" -"-^ "»■"■»' 

■a. da,. for ,„„„„,^ „ w,.„,„g ™ 

An implem.n,a,ic„ of self.„,app„,g ,„faces is described in 1 1 .5| 
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2 Computer System User 
Interface 

A passive self-mapping surface can support a graphical user interface to a computer sys- 
tem, mediated by a sensing pen: 

• encoding of position to support context-dependent button clicking, 
drawing, w riting and gesturing, or 

• encoding of object id to support context-free button clicking, or 

• encoding of page id and position to support context-free button clicking, 
drawing, writing and gesturing 

• invisible encoding to support clicking, drawing, writing and gesturing 
anywhere, without visible interference with surface features 

• fault-tolerant encoding for immunity to surface damage and sensing errors 

Minimal interface: 

• consists of a physical page with a virtual page structure 

• page surface contains features, e.g. graphical user interface elements 

• features are typically printed onto the page surface 

• physical page surface can be any surface, including the surface of a sheet of paper 

• surface features are represented in corresponding page structure 
(there is a one-to-one mapping between the two) 

physical page is a (passive) self-mapping surface 

• map uses fauit-tolerant optical encoding 

• encoding is typically printed onto the surface using invisible (e.g. IR) ink 

• map is sensed by wireless optically sensing pen or st\'lus 

• pen senses map when nib is close to or in contact with surface 

• pen senses map reference at sufficient rate to capture human hand\sTiting, 
i.e. at 200 dpi or greater and 100 Hz or faster [10] 

• pen allows user to indicate "pen down" and "pen up" action, 

e.g. via button on shaft, or sprung button or pressure sensor coupled to nib 

• pen generates digital ink with embedded map references 

• digital ink consists of strokes 

• stroke consists of timestamped positions bracketed by pen down and pen up 

• pen transmits digital ink to base station 

• page structure is known to base station 

• base station interprets digital ink. with respect.to page structure, 
e.g. as operations on a graphical user interface 

Page structure; 

• page structure defines graphical elements and input elements 

• graphical elements include text, graphics and images 

• input elements include hyperlinks and form fields 

• base station interprets digital ink as element selections, 
form field fill-ins, and hyperlink activations 
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Marking versus non-marking pen input: 

• user gets visible feedback on input because pen has a marking nib 
pen also has a non-.arking nib for command input (e.g. button presses) 

Network: 

• page structures are available on network 

• pages are uniquely identified within particular domain 

• base station retrieves page structures on demand by na-e id ^fr. 

• hyperlinked objects are available on network ^ 

• base station communicates with linked objects to handle hyperlink activations 
Base station is printer: 

• base station is a printer 

• prints hyperlinked pages on demand 

• prints subscribed pages autonomously 

Persistence: 

• page structures are automatically arch i ved on network 
making all published content persistent ' 

Handwriting recognition: 

• handwriting is automatically converted to text in text input field 
handwr.ting recognition uses dynamics in digitalink 

• -recognized handwriting can be automatically routed to human operator 

Verified identity; 

• pen acts as identity token 

verified Identity allows secure transaction authorization 
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Architecture 
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3 Tag Tiling 

each tag specifies its own%osi io^on the ur 2e How f °" " ^"^ 

face is somewhat immaterial so lonVa! r f ^""^"S^'' °" ^ sur- 

where tags are required, e ^ n tL a Jve a'eas of bu« " '"^V"""."'"'^ '^"^^'^ 
is sufficiently dense if the'ae sln.^r - buttons or form fill-in fields. A tag tiling 

any active area on thf surface' °" ^ ^'"^'^ "dick" within 

There are two reasons for using an irregular tiling: 
. * r:pi?;'^^ '"-^ ^-'y -PP^^* - ^ surface Of arbitrary topography and 

are always on or always off produce a column of dots which 

a?fS':" ^^"'"^^'^ ^ -^^-^ -^-•'-aty topography and topolo.y 

(c) map the tag triangle to each triangle of the mesh 

(d) project each mapped tag triangle onto the surface 

(e) render each tag in each projected triangle on the surface 

L J, ^Micfc uiL separation of any two samn es s m^vpr l^-cc th^^ ^ - • 

One way to eenemrf^ ^ P^icc ^- . ^ i. ^ speciHed minimum, 

vvajy lu generate a Foisson-disk distnbut on is rn ////.^»- tk^ • • 

points [6J. Another way is the so-called U^^^Z. ^^^Z^ ^7:: °' 7^"'" 

dom pos.tion a, a time and tests it against existing positions ['j " 
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Figure 1. Tag triangle mesh and tag triangle 

Each tag must now encode the following: 



• the id of the tag position within the tag triangle 

• the id of the tag triangle within the surface 

• the id of the surface 

A surface-specific description of the tag tiling can be retrieved based on the surface id, 
possibly from a network. The description includes the following: 

• the shape and size of the tag triangle 

• the distribution of tag positions within the tag triangle 

• the arrangement of tag triangles on the surface 

A particular tag tiling may be used for a class of surfaces, e.g. all sheets of Letter-sized 
paper, all double-donut Zap widgets, etc. If the tiling is regular in nature, e.g. if the surface 
is planar, then the triangle id can typically be translated into a surface position algorithmi- 
cally rather than by table lookup. 

Sensed tag information can be translated into a high-precision surface position as follows: 

• translate tag triangle id into surface position 

• translate tag position id into offset and add to surface position 

• add offset of tag in imaged area to surface position 

Tag tilings using non-triangular polygonal mesh units are also possible. Rectangular and 
hexagonal tilings of a plane are obviously possible, for example. Multiple ditTerent polyg- 
onal mesh units can also be used in a tiling, so long as they are identified in the tiling 
description. Multiple tag position distributions can also be used in a tiling, so long they are 
identified in the tiling description. 

When a lag triangle is mapped onto a mesh triangle, distortion may occur because the 
mesh triangle is only ^/f/^/^/'-equi lateral and may vary slightly in size from the tag triangle. 
Furthermore, when the mesh triangle is projected onto the underlying surface, distortion 
may occur because of the greater detail of the surface. The first kind of distortion can be 
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tion can be reduced by using sma ler S 1", -^^^ Jr.angle. The second kind of distor 
large enough to support a p^opTr Po Lson dfS': ^ ° " '■"''""'^ "^"^^ ^'^^^^ be 
the tag tiling description caTbe a4 ed v "fh its d'-w'"" ^'^'f ^^'y- ^^^^ triangle in 
tion can be included when a tag isTnterpTeted ' ''''''' 

-e way as the tags, and the latu^raTd raS^wlf.- ^I'^-r:;;^^^^^^^^^^^ 

dtes^^nTLl^n^^^^^^^^^ -Ponant that the distortion 

versely, that it does nofca s^e ta. Zerla a'^r'T' 'T''''' ^"^ ''''' 
orrending tags can be removed, so ,::g S^bll iS ^t ^eX^rtair i^ ^ 

triXat::;;r:ttru:;r:^^^^^^^^^^ 
^Srang^p:^ 

poses Of ensuring tag s^araTnTh^rrrJ "u^^T drto'^f " 

itself across an edgrb:fori;fareTelte;fro:: a^Tef ^^^^^ ^ ^P^' 




'^'^ w!tSout".'!lS'' ?K""'^"" '"^"9le pair arrangements, 
Without and with mirroring (figures in brackets) 

°:5iXZTon t - least one ful, tag when 

■mage a circular area lar^e enouoh rencnm 1 ^'"^ sensor must 

tag must also be added f the ndiu of rh^' I ^he radius of the 

'hen the maximum jiS Radius mus also h '"nf . '''^^^ ^^^^'""^^ ^ '^e «rid, 

illustrated for a triangular g ." irFiourl^^^ ^^^''"^ ^'"'^^ -^8^^ This is 

of all regular grids. " triangular gnd provides the best tag packing 

sensor is given by: crrcuiar area which must be imaged by the 



(EQ1) 
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4 Tag Capture 



There is wide varialion in Che lill at which Ihe pen is operated by dilTerenl users ,„H 
a'lri"raT,M, i!,r^' ""'^S ' -il' i" .he range 0- ,o 60' 



lateral 
plane 



Jon0\tud\na\ 
plane 



Figure 4. Lateral and longitudinal pen tilt 

Assuming simple Hxed optics, tilt introduces t^vo probl 



ems: 



• out-of-focus blurring 

• perspective distortion 



The degree ofblurring depends on the depth-of-neld of the optics. 

Perspective distortion makes position tag detection more difficult Conceotuallv the tilr 

r^-— ^^^^^^^^^^^^ 



und\eiorteci 




per3pect\v!i 
distorted taq 



Figure 5. Tag perspective distortion 

Since it is impractical to image the area directly under the nib, tilt also affects the distance 
from the nib to the center of the imaged area. This distance must be knoW to a1 io vv an 
accurate n.b pos.t.on to be derived from the position deterrmned from th p^, L tl" 
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pen axis 



imaging axi5 




(pen nib) 



lens plane 

paper at 9 pen tilt 

paper at zero pen tilt 



Figure 6. Tilt-induced effects 

Figure 6 illustrates the effect of tilt on depth, perspective distortion and displacement in 
one dimension. D is the nominal distance from the lens plane to the paper- surface when 
the pen is vertical; d is the actual tilt-induced distance to the center of the imaged area (B); 
a is the width of the imaged area; s is the distance from the pen axis to the imaging axis; 0 
is the pen tilt. 

Three tilt-induced effects are of interest: the change in distance to the paper surface, the 
perspective distortion of the imaged area, and the change in the position of the center of 
the imaged area, relative to the origin (i.e. the pen nib position). 



The tilt-induced distance to the paper is given by: 



(EQ 2) 



If O is large compared with this effect is less significant. It needs to be quantified rela- 
tive to the depth-of-field of the optics. 

The perspective distortion of the imaged area, given by the ratio of imaged feature sizes at 
points A and C on the paper surface, is given by: 



cl + A 



(EQ 3) 



Where: 



A- = -(cote) 



(EQ4) 



If D is large compared with a, this effect is less significant. \x needs to be quantified rela- 
tive both to the depth-of-field of the optics, and to the size of the position tag and the 
required image sensor resolution. 
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The change in position of the center of th» • j 

given by: °^ ""^S^'^ ^'^^ W ""elative to the origin (O) is 

J(sece - I ) 

(EQ5) 

This effect is always signiHcant for non-trivial tilt. 

ret:s:l;^:ilX","j;:;^^^^ acceler^eters, is inadequate 

- that the page is si.ply^a pieTe^^^^^p^ L'ltl t^^Certr^nt'Srer^"' 

^^:^:Ss-i:.~ optics an. an 

oise^v^^oVt^e:^^^ the perspective distortion 

the targets have a comX s^ Sre wM^ 'J ''^^f This is non-trivial because 

distorted. This can L amelio iTs / PO'^""ally dimcult to detect when they are 

tiling which is as er trietect than Tta"';' ''"'7^' ^^"'^'"^^ '"^^ 

reduces the tag resolution m .1 k ^ themselves, although this further 

Simpler patte.\f.i:':z,ei;:;:t:t^p^^^^^^^^^^^^^^ 

"onliSranSteTalTi^lo^^^d^^^^ - allow both 

spots two on the longitul" a^ttTtroJ hH^^^^^^^^^^ of four separated 

puted separately from the ohc^r^.^w u • / ^' '^''^ ^long each axis is com- 
is illustrated in Figure 7 '^^-^Ponding inter-spot distance. This 



"° '^'"^ lateral tilt 



u., J- , ., lateral and 

lon,j„u.d,r,al CIt logicudinal Cilc 

Figure 7. Tilt-induced spot pattern perspective distortion 
{arrows show direction of tilt 
dashed lines indicate changed inter-spot distance) 



The capture of spot images and tag images can be time-mul.iolexeH Th. " 
eas.ly be operated at twice the 1 00 Hz tag rate, and he ; m M '"'^H 

between spot and tag capture is unlikely to introduce error nc?,', "Iv ll" '"'TT 
over time. i>mce tut typically vanes slowly 
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The position tag macrodot pattern contains mostly high frequencies, and so reduces to a 
uniform gray if sufficiently low-pass filtered. If a tilt pattern spot is sufficiently large com- 
pared with the size of a macrodot, then it is easy to separate from the background of the 
position lag data. Once a spot is located, its center can be computed to greater accuracy. 

As an alternative to projecting a spot pattern, each tag can include a structure which serves 
the same purpose. This structure should ideally project outside the tag body, to maximise 
its size and therefore maximise the accuracy with which perspective distortion is mea- 
sured. Adjacent tags can have interleaved projections so long as they are non-overlapping, 
as illustrated in Figure 8. 




Figure 8. Interleaved tags with external perspective targets 

Once one spot is found, its partner is found along the same longitudinal or lateral axis. 
This makes detection more efficient. Similarly, since tilt typically changes slowly over 
time, the last known spot positions provide a good starting point for detection. At a more 
sophisticated level, longitudinal tilt and lateral tiit angular velocities can be maintained 
over time, allowing more accurate prediction of spot positions. 

Perspective distortion can be eliminated entirely if the capture lens is always kept parallel 
to the page surface. Rather than achieving this using a moving lens, an alternative 
approach uses a wide-angle lens which always captures some part of the paper surface 
without distortion, as illustrated in Figure 9. 



Figure 9. Undistorted imaging through wide-angle lens 

The lens system can be further refined to provide ditlerent focal lengths at different posi- 
tions, tuned to the expected distance to the page at the corresponding tilt. This may elimi- 




paper at 45° per\ cilc 




paper at 15° pdn tilt 



nib 



paper at 0° pdn tilt 
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than when imaeina the rioh, c:h 1 . ^ ^ ^'^ ^''^^ a^a of interest 
spcs are res.ric,.,, ,„ a sub^™ of Z ^^7, . st i, "" 
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Applications 
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5 Digitizer 

5.1 Large-Format Digitizer 

A passive self-mapping surface provides the basis for a large-format high-resolution H" • 

An imaging pen produces a stream of digital ink when interactina with the surface Th. 
^^Jds^rriz^nf ,^ '"f ■f"™" "> tended vin„„ workspace which 

5.2 Dynamic Handwriting Capture 

tabrtlTdviaZhT^^^ '"'^ for a low-cos. high-resolution digitizing 

taoiet tor dynamic handwriting capture in conjunction with an imaging pen. 

5.3 Dynamic Signature Capture 

tabirfo7d;I';'"'T''"^H P'^"'''' high-resolution di.itizin. 

tabletjor dvnamic handwriting capture in conjunction with an imaging and pressure-senst 

5.4 Registered Projection 

grapt^'Zse^ite^^^^^^ " ' ^'2'''^'"= ^ screen-based 

graphical use interface system to a personal computer or workstation. If the screen output 

w th the T''?" '^^'"^ " P^J^^'^'^ self-mapping surface, in perfect egistra fon 

with the surface map. then the surface becomes an interactive drawing surface vvhere 

" ^'-^ of .nterrctT::^rd:iit 

The projector can include an imaging unit which senses the large-scale map of the surface 
s encoded at multiple resolutions) and uses this information to controK^ rvo whth 
registers the projected image with the surafce map. 
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6 



Situated User Interfaces 



6.1 



Device Control User Interface 



There are many electrical and electronic devices in the home and office which have some 
kind of user interface for controlling their operation. These include office equipment, 
audio and video equipment, kitchen appliances, heating and cooling systems, etc. Even 
light sockets have on/off switches and sometimes dimmers, and in many countries power 
outlets have on/off switches. 

Office equipment and entertainment equipment is increasingly networkable - i.e. devices 
come with interfaces to standard local-area networks, allowing their operation to be con- 
trolled over a network. The advent of standard wireless networking technologies such as 
Bluetooth may see an increase in networking support in such devices and appliances. 

Some networking futurists predict that even light sockets will one day be networked, 
allowing their status to be queried and their function to be controlled remotely. 

If a particular device is networked, and the network interface of the device allows the 
device to be fully controlled, then it is possible to completely separate the user interface to 
the device from the device itself. Furthermore, the user interface can then be implemented 
as a passive self-mapping surface, sensed by a wireless sensing device carried by the user. 
The sensing device must be small, unobtrusive and portable, it might be embedded in a 
ring, glove or finger glove worn by the user. It could also be embedded in custom eyewear 
with interaction controlled by gaze. 

The self-mapping surface is coded with the unique id of the device, and is printed with the 
user interface of the device in the form of buttons etc. Being passive, the surface gives no 
feedback to the user as to the status of the device or its user interface. The base station for 
the sensing device carried by the user resolves operations on the self-mapping surface 
with reference to a user interface structure previously selected by the user from the device 
itself, or designed by the user using elenients provided by the device. 

User interfaces implemented in this way have several advantages: 

• once the infrastructure- is in place, the cost of manuifacturing the user interface is 
removed from the cost of manufacturing each particular device; the cost of the user 
interface to a light socket, for example, is non-trivial 

• a user interface can be replicated by simply printing another copy 

• when a user interface becomes damaged it can be easily replaced 

• when the fimiware in a device is updated, a new user interface can be easily provided 

• a user interface can be customized by arranging elements and printing the result 

• a user interface with a particular style can be chosen from an available set 

• multiple user interfaces can be grouped together 

• a user interface can be provided on the device itself by the same means 

• access to individual user interfaces and functions can be controlled, 
since each sensing device is tied lo a particular user's identity 
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6.2 User Interface on Toys 

s'e^-'i'^L^Iu'^^^^^^ inexpensively with the user interface to the toy as a 

use. ^^Sf^^::^^S:^~t^:--:^ to interact wi^hl: 

console, or a processor embedded in the Z tse f to n 7 ' "'"'"k" '""^P"^^^' 8^"^^ 
effects and other behavior. ^ ' *° P™'^"'^^ graphical output, sound 

-rolf^tt^™ ^-^-"S of submarine 

runs on a PC or game co:so e S^'gam^ s SrerL'^eT?"' '"""^'^^ ^^"^^ ^-^-^ 
face contained in the submarine nfrhTn J . u ^^"^"'"^PP'ng surface user inter- 
cates wireiessly by B.ueroth w th s^^^ ^'-^ — ""i- 

console. The PC screen or conso -connect d te " sion ^^"^^ 
. . part Of the user interface. The se-r-mapping^r^rpr ^de^^reXd^us^^^^^^^^^ 

XreVstemrCulm^S"^ P--g them via a 

interface componems assembling 

pre-defined user 

6.3 Defect Logging 

of detected defects or parts reauila 1 ; ''^S'''^'' P'-^'^i^ely location 

appropriate sensing device ' s.mpiy by touching the surface with an 
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7 Hybrid User Interfaces 

7.1 Hybrid User Interface to Web Browser 

Self-mapping surfaces containing printed Web pages ^can be used to request linked Web 
pages for display in a screen-based Web browser. The printed Web pages provide an 
extended user interface to the Web. Printed pages in magazines can also be encoded as 
self-mapping surfaces so that their printed Web hyperlinks are also active. 

A single page id can be used per page, or individual object ids can be used for each 
embedded hyperlink. The latter is more practical, since object ids just have to be translated 
to Web URLs, probably by some network server. In the former case, someone needs to 
keep track of the printed layout and logical content of each page. If the Netpage Web 
printing service is used [2], then this comes for free of course. 

All that is needed is a special pen which talks to a Web browser rather than the printer, or 
a normal pen which can be placed in this mode. 

7.2 Hybrid User Interface to Computer Application 

The user interface to a GUI-based computer application running on a multi-tasking com- 
puter can be printed as a self-mapping surface on a user interface or command ''card'\ The 
printed user interface can include a "digitizer pad" area for moving the GUI pointer rela- 
tive to the application. Invoking any function of the application's user interface or moving 
the GUI. pointer, automatically makes the application current - i.e. if the application is run- 
ning in a Windowed GUI system then its window is brought to the front and made current. 
If the application is not currently running, then it is automatically launched. 

The printed user interface for a text-oriented application can contain a printed keyboard, a 
general-purpose handwriting input text field, or both. 

A personal computer system or workstation can thus potentially consist of a screen for dis- 
playing GUI output, a number of application-specific printed user interfaces, a sensing 
device (typically a stylus) for sensing user operations relative to the printed user inter- 
faces, and a computer which receives wired or wireless transmissions from the sensing 
device, runs applications, and interprets sensed inputs relative to each application. 

Each printed user interface "card" can be encoded with a unique page id specific to the 
application, and tagged with an attribute which instmcts the personal computer or work- 
station to interpret operations on the page relative to a local instance of the application, 
even in a global networked Netpage environment. 

If the computer is a network terminal connected to a LAN, an intranet, or the Internet, any 
interaction with the printed user interface launches or interacts with a networked instance 
of the application. 
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8 Tag Sensor 

8.1 Wearable Sensor 

A sensing device for a self-mapping surface worn on the body, e.g. in the shape of a ring, 
armband, bracelet, thimble, or mounted at the end of one of the fingers of a glove, etc., can 
be used to conveniently interact with a self-mapping surface. It can contain an active sen- 
sor for sensing the area of the self-mapping surface with which it is brought into contact or 
proximity, and transmits digital ink by wire or wirelessly to an associated base station, e.g. 
via Bluetooth. 
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